Then it won't accept the note or it won't delete the note.

This is the main design flaw to Nostr: that npubs have no control over which relays read their data. The solution would be encryption, I suppose, with only "good actor" relays receiving the key for your npub.