A decent way for clients to handle spam comments on notes could be to use spam reports by the note author. This would handle the case of no common follows as well as non-account viewing on web clients.

It looks like Snort and Primal are both doing some filtering?