In your example, what is the more logical conclusion that could be drawn - that once you jump off of a building, you move towards the ground, or that the whole world and air moves up towards you?
You're venturing into a completely theoretical discussion in order to obfuscate the point being made.
To my point, it does matter, because the whole basis of the majority beliefs is based on the idea that the Earth is moving, when there is no objective evidence for that being the case. It's exactly why relativity what invented; it's a completely theoretical concept that pushes reality into the imaginations of people.