I think it can be due to not properly loaded following list.

If you update your relays, while your local following list is not full, you will overwrite it.