I sympathize with your viewpoint. People who believe that libertarian principles are like the simple rules in a snake and ladders game indeed take on a sort of arrogance, which can lead them to justify manipulation of the use of force in the end. I’m with Van Dun that the most foundational “ought” that can be derived from an “is”, is that humans ought to be reasonable; and hence that reasonable argumentation is the bedrock of any peaceful, orderly, convivial society.