It would probably best be handled by pinging an indexer like nostr.band for the list of followers of that profile, and then compare it to the list of people you follow, which is already cached from your contact list.