That stinks. It's happened to me a few times. I've found that it happens when I switch clients and the two clients don't have the same relays. For example I had to re-add all the relays to nostgram.co. Luckily there is a tool on there to restore.
Will be much better when it doesn't happen and things sync more seamlessly.