You can have non-custodial wallets on your computer/phone. The keys would just not be consider cold as device is internet connected.