Yeah I think this is where anarchism clashes with a version of what you might call small “l” libertarianism.
There’s a certain low level of guardrails needed to actually maximize freedom. Bitcoin obviously being a great example of rules without rulers.