Ledger’s code is closed source so you have know way of knowing if there’s a back door. You have to trust what they tell you. Most other hardware wallets are open source so any back doors would be immediately spotted and broadcasted to the community