If women are not direct public actors (as before feminism, where their male head-of-house often had to open bank accounts for them, agree to their contracts, manage their property, agree to marriage proposals of their female dependents, vote on their behalf, etc.) then it means that men are interacting primarily with other men, rather than directly with women.

How many men would give up the ability to interact with all women, in order to limit the men who can interact with "their" women? Not many, I think.