Yes, agreed. The controls ought to be the people, especially heads of households. The more people remain ignorant of their responsibility to self-govern the more they abdicate it, forfeiting their right to those who desire power over others. This is the real issue: not that evil people exist but that otherwise good men do nothing about it.
Proper government is a mediator between men, organizing them in ways which they would be unable to achieve apart from one another. It is a collective decision making apparatus which does not usurp the individual authority, rights, and responsibilities of free men but augments and organizes their capacities to the benefit of the common good.