followers is a broken metric on nostr. its very difficult or impossible to reconcile, also users comes and go, just be active consistently and your reach will improve