Follower count on Nostr is a fiction anyways. Counts are unreliable, and once you have been here for a while, a good number of them are just people who lost their keys. Focus on who is interacting with you now, and follow them.

Who you follow > Who follows you