This happened to me with Astral where I started a new "instance". It had just started to sync. I performed a small edit of my profile and saved it. The next time I opened Damus all my Follows were gone, I had to collect them from scratch.