I think you are forgetting that I can connect to all the relays as @jack using his npub, but it doesn't mean that I'm Jack. And if the relay records my IP as being Jack's, well that's the relay's problem. In other words using just your npub you are not losing any privacy. Btw, if you are not using a VPN, then your privacy is completely shot anyways