I'm largely in agreement with what you're saying. To me there are few to no billionaires who are allocating their wealth towards building the next Notre dame, instead they are riding the coattails of innovations past. It looks to me like they are more interested in earnings than allocating capital to further true innovation, which is why many of these industries have stagnated now that the visionaries are gone.
I think you're also correctly alluding to these beings symptoms of the fiat system and fiat thinking. It's not so much the concentration of immense wealth, but what they are doing with it.
If I make a billion dollars by shorting a market, but I don't use that to innovate, even at the risk of spending it all, then it just seems wasteful. If I make a billion from creating products and services, it's not quite the same. It's not a problem exclusive to that class though, but they do have the means, which the average person does not.