One could argue that in an environment without a state we all have the right to do whatever we want including doing violence on anyone. In that case the government could derive that right from the people.