For unfollowing, I believe the relays take time to update so they might serve cache data for awhile.