The follower count doesn't matter. Each person that is following you should know it, not you.

Once they're following you, if they're going to get your notes is a different problem.