I have noticed the more clients you try the more likely it is to happen.

Just be sure to backup via https://metadata.nostr.com/ and it will make it easy to get back your follows.