On the cold card you can enter in or remove passphrase to set up signing from that configuration.

Would also recommend keeping the “blank” (mnemonic) passphrase with some duress sats maybe.