Agreed, tho for slightly different reasons.

Like speciation/evolution, after a certain size of population is met votes start to get averaged out.

Voices and opinions get drowned out.

Neutral votes become a much more effective target for manipulation/influencing.

Lastly, it is much, much harder to have accountability be enforced via the populace. Without this check, ineffective/harmful actors are allowed to maintain their seat for much, much longer.