I tend to agree. I haven't thought through it enough but here's another aspect.
Relays can already delete/block/censor any npub they want. Allowing the key holder to delete their own notes doesn't seem to provide much of any benefit on the censorship resistance side.
The censorship resistance of Nostr is more about there being many relays coupled with the signing of messages allowing for more privacy than having a centralized ID system.