Follow lists need... Improvement? Or, maybe it's the responsiveness of the relays?

Sometimes I find I've followed someone. Then I see their posts via someone else, I check their profile and it shows I'm not following them. So I refollow.

The inverse is true too. I'll unfollow someone, then still see their posts. Try to unfollow again, hoping maybe it'll stick the second try.