No need for centralized authority. Adium did it for IRC DMs with OTR.

You just share ephemeral keys, it's local client based. Servers only help if you want to share the keys with a different client. But some galaxy brain can probably figure out how to do that using Nostr itself.