I think you need to look honestly at yourself and ask, am I the asshole?

Who is harmed, by a property owner doing with their property as they wish? You don't have to go to this establishment.

This is called Not in my Backyard. NIMBYism. It's why affordable housing is difficult. People are permitted to build additional dwelling units which would provide plenty of affordable housing for everyone.

If what you're asking is in violation of the non-aggression principle or some violation of property rights and individual liberty, you should probably rethink things. You might be desiring the oppression of another and that is not compatible with true liberty.