OK sure, but in the context of immigration, are you really saying that the existence of public commons constitutes being "forced" to interact with other people? Because I think that's quite a stretch...
You could in principle live in a tower with a helipad, or Iive your existence on a private luxury yacht, never having to step foot on public property or be within 100 m of anyone outside of a carefully cultivated bubble.... it's super expensive of course, but it's possible.
And then the other problem is, from a fundamental moral perspective, if you are being "forced" to interact with people in public, then by reciprocity, they are being "forced" to interact with you. Who gets to have the moral claim of grievance here?