Principles of Economics Chapter 16: Violence

You're right in the individual sense. You cannot agree to reject violence if someone is directly using coercion against you.

The context the quote is referring to is about deciding on which social systems we choose for organizing society. Do we choose the market order of voluntary exchange, mutual respect, specialization, and the division of labor or the State order of the initiation of violence, coercion, and intervention.