That’s not the danger, as I understand it, of a 51% attack. The danger is an entity (government/ hackers etc) seizing the hashpower of those 50 miners (which is getting even more centralised over time) and then forcing a change to the base layer.