I looked for bug and did not find. I tested with just my pubkey from a fresh database and it worked fine.

Then I thought "most people's ContactList doesn't have per-person-tag relay hints". That's probably why. Probably has nothing to do with just using a public key.

One fix: setup a number of popular relays, mark them as "read".

Another fix: click avatar of person that isn't being loaded, and look at what relays gossip thinks they are on. You can follow them again and type in a relay that you know they actually are on. That's a manual PITA but should work.

As you encounter them through usage, gossip will make relay assocations, so you don't have to do this for everybody.

As other clients support kind 10002 this will fix itself too. But that might take a while.