I'm not talking about "toxic maxis" as some fringe minority you can just avoid. I'm talking about the entire current Bitcoin culture, where these people control the most important businesses, mining operations, media, and infrastructure around Bitcoin. That 0.1% you're dismissing control the whole network - or at least all the coordination layers that matter. They run the conferences, the media outlets, the major mining pools, the development funding. They define what's "legitimate" Bitcoin discourse.
You say most people will never encounter them, but that's only true if you never try to build anything, never participate in development discussions, never try to organize events. The moment you engage beyond just holding, you encounter the gatekeepers.