It could be an app that did not fetch all your contacts, and then it publishes a new following list missing all your previous contacts. The relays just keep the most recent one.
Discussion
good info to know. I'm guessing there are 2 methods to count followers now, cache (primal.net) vs relay method (depending on the max no of events a relay can fetch) - where would your original list be from?