You can both also create a new keypair (only known to you and other party) and then DM with each other. Problem solved