If you choose to proactively defend your rights and use force, you must be extremely careful. Because by doing so, you’re almost always risking becoming the aggressor yourself—violating someone else’s negative rights.
So you’d have to be absolutely certain that you can later prove, beyond doubt, that it was a legitimate act of self-defense. And that’s objectively very hard to do.
If you can’t prove it, then you’re not the victim—you are the aggressor, and you’d be fully responsible for the harm caused.
But I guess this is no difference to today. Except for the government for example, who is allowed and breaks negative rights daily