I'd say it is a vanishingly small percentage of people who "designed" society by enforcing their choices on the rest of us. I also disagree that said designers were all male.

To some degree, society is just today's ruling choices laid atop the prior day's ruling choices with near infinite recursion.

That said, we can and should be trying to make society better for all of us.