I don't. I follow everyone that interacts with my notes and only unfollow for shitcoinery or spam.