"Not your keys, not your coins."

This isn't just a slogan, it's a cryptographic truth.

Only with your private key can you sign transactions and prove ownership of BTC.

Exchanges can take it away. A hardware wallet can't.