While I think, clients and certainly the protocol should allow you to follow a million users, I also think, relays should charge for these more costly queries accordingly, which they don't do yet, so the resort to putting limits in that are not clear to the users.