I just copied a few people but some of them were following like 700-800.

Surprisingly, the timeline isn't overly populated. I'm guessing lots of dead accounts. I also only have 2 mainstream relays so that could be limiting it too.