This is why Decentralization is a thing. Go to a jurisdiction that socially share your morals. We do this today.
I'm not hanging out near drug dens during the day. I'm not trying to find friends at the local pub, since I'm not a drinker.
If hippies want to have their socialism commune, buy some land and farm all day. I don't care. The point is that I can justify an AnCap viewpoint, secular AnCaps cannot.