> the freedom of taking direct action against something you dont believe in
If direct action means pointing it out, explaining it, cursing it, removing these people from your property... then I totally agree. Having a stupid opinion is also freedom. But this goes much further. This was an aggressive attack on someone else's infrastructure, a violation of the non-aggression principle. Basically, the exact behavior we want to fight against.
So I don't see the difference between this and what the NSDAP did in Weimar. If racists were banning Jews from going to their own shops, publicly criticizing them, then ok... But the problem started when they started aggressively using violence to impose this on others.