Most clients distinguish between DMs from known & unknown npubs.

You don't need to delete the unwanted DMs but you could easily mute the npub.