Pretty sure this is already done. Just login with your public key instead of your private one.

Apps like Nostur also provide an anon gues account.