The problem is that you only get to make a voluntary association once. After the initial agreement it becomes an apparatus of coercion. That is the whole point. You join because you want to coerce other people to not take your stuff. But that also means you can't take other people's stuff. If you decide to dissociate so you can, no one will honor that new choice. You will be coerced to follow the rules where you live.