"Monopoly on violence in a given non trivially sized area"
That is the standard libertarian definition. It fits every state to ever exist. It reflects the crucial difference between an organized and/or cooperating group of people and a state. It makes sense and works.
What is your problem with it exactly?