Aren’t those two things entirely compatible? You have the liberty to form a minarchist town

Minarchism is a form of libertarianism. Maybe you’re getting closer to anarchism.