Depending on the client, you might be seeing replies too. Amethyst has a nice follow view of just posts, not replies.

A tame option per follow would be a nice addition. Click it if you are seeing too many notes, and it would apply some rules to reduce the noise. This could be client side.