Perhaps it is related with "max bytes accepted by servers" when pushing events. My following list is getting bigger and maybe the issue is related with that. By the way I am using my own paid relay and I don't know if I have this trouble too.
Discussion
If this is the problem, the fix needs complex topics as knowing max bytes you can push on public or paid relays and also following lists are limited by this.