the way i would prefer it is use nip05 relays to get their relays, if they have no nip05 try your best based on popular bootstrap relays. Once you have their relays you know where a particular user reads from and writes to. So when sending them a note or replying to them you select their read relays. When reading their notes you pull from the relays they are writing too. Pretty straightforward.