Damn that sucks. Easily backing up follow and relay lists should be a feature in clients. They can be lost in one event but hard to rebuild manually.
Discussion
Or there should be a confirmation when the client sees a new follow list event that differs from the current (maybe with some significant size change). The user can choose which to retain
But then users would have to rely on the client to have that confirmation feature. Backing it up is the safest