Well how did they get there?
If you are in my house, how did you get there?
Did you come inside with or against my consent?
If it was consensually, what were the terms, if any Are you just visiting or do we have some contractual agreement?
If you're just visiting I can ask you to leave for whatever reason.
If we had a contract that we each agreed to voluntarily, then your access to my house world be subject to that contract.