If every individual has the same authority, no individual has authority over another. That's one problem, because parents naturally have authority over children, and then who is to say when those children become adults?
Secondly, defending one's rights and property against a bad actor is in no way violating the bad actor's rights and liberties, but a just and expected response. If someone wishes to defend his rights and obligations from a violator, he may delegate that defence to another. Multiple people may choose to delegate that to the same person, and this we call a sheriff, judge, or otherwise "the authorities."
Statism, the state-centric view, is not natural, but that is not to say the state ought not exist. Localism is individual- and community-centric, and they naturally have the collective right and responsibility to defend their individual rights and responsibilities. The differentiation is that those rights and responsibilities do not originate with the state but are intrinsic to the person.