The relay you are using for the DM can be common but the note you are sharing can be on a relay the recipient doesn’t have. So they see the DM but don’t know where to fetch the note, which is what you described happened