We can specify relay in `NIP-05` I use the same, didn't had this issue!

```

"relays": {

"PUB_HEX": [

"wss://relay.one",

"wss://relay.two",

...

]```