You are missing the fact that if a large majority uses a single client and that client manually shadow bans a user, then it's exactly like twitter.

That user will have reduced reach since most users won't bother forking or using a different client.