There are a lot more things that go into security than just your hardware wallet. It's just one component, and managing who has physical access to it and always using it in a private location with airgapping features go a long way imo. And that's just with a single sig wallet. Two wallets from different brands and a remote key from someone like Nunchuk is also an option.
People are good at scaring folks into thinking their hardware wallet is a single point of failure when it doesn't have to be. If you're losing your Bitcoin, it's probably not because of the wallet you chose. Unless it was a ledger, lol.