The problem of followers disappearing from can be solved if clients implement local storage of your contact list. Each follower is tied to a certain relay that they technically followed you on. If you remove that relay that the following event is stored on, then their follow no longer appears. f you add that relay back, the follow will appear again.