#Yestr!
I have often thought about that.
If you could time travel, you would also have to teleport to a different point in the universe. It's impossible to know exactly where that place would be. Where would your reference point be when everything is moving?