Yes but if you, a single peer, run the client and the server as well as me, another peer, also run the client and the server then that is equivalent to us using a p2p app.

To modify Nostr to be a p2p app this is effectively what you would need to do anyway.