I had a bug in Nostur where it would lose track of who is already following you and then it appears someone is following you again when they update their contact list, or you open their follows tab.

Unfortunately the only way to fix it is to do a full rescan, which I will have a button for in the next release.