Choose whatever alternative you want as long as it's open source.
The only controversy over Trezor I'm aware of is their use of Wasabi's coinjoin. But that's an optional feature in the client that doesn't impact the fundamental security of your wallet.
The difference with Ledger here is they have coded a method of obtaining the private keys from the wallet to any device it connects to. This undermines the entire purpose of the device.