the way to count follows on-protocol is to fetch contact lists, these are huge though, so downloading 800 of them is quite expensive.

damus is a pure protocol client and doesn't rely on special servers that count things like primal does.

follow counts isn't that useful though, since anyone can spam contact lists to raise follow counts