Yep, I've ran into that issue with not all of them connecting and indeed, a restart almost always helps. Probably some issue with Damus itself.

But I also did a cleanup of the relays that I previously had, as some of them were not even valid anymore. It's probably a good idea to do this sort of cleanup every now and then.