Perhaps you could aggregate the follows across N servers, much like how notes are aggregated across N servers. Then you have a market of aggregators that have a track record, e.g. for uptime, and liveness, could charge a fraction of an msat to store the data etc.
Discussion
That's exactly what I proposed on the trusted assertions PR that you downvoted. There are 100s of things like the follower count that could use these types of aggregating services.