Mandatory confiscation of any innocent person is never fair. Apply the same logic to your neighbor.

“Hey neighbor I’m here to take x% of your wealth because I am going to build y services for z people. If you refuse, then you’ll be murdered or imprisoned. If you don’t like it, take it up with your representative.”