I guess this is where the social graph would be useful. Only show a follower notification if the person following is within your social graph up to X tier specified.

We have this same social graph feature in Nestr for sorting replies underneath threads and filtering out spam replyguy posts.