Lots of stories start out in the middle of the action (in medias res) even if they’re not about time travel. Seems fine to me.