You would still hold the private key. You would just use the NIP-05 as your login credential.
Discussion
I guess I am confused. Logging into what? A client? Doesn't matter unless that client somehow has access to your private key for signing through that login.