I guess I can see that. According to Ledger they don’t have access to it unless you give them access. Sounds like trust is the issue which I know many don’t have in Ledger.
Discussion
Private keys are meant to be air gapped or at least never leaving a device, especially not sent to the internet - no matter what alleged encryption or security is used.
Imagine to get access you need an email and password. They know your email. Now your password. You effectively transformed your secure private key into a short password brain wallet or low time brute force puzzle.
Ledger is not something I’d recommend to anyone, even if it’s fairly mature and nice enough general UX.