Hey Geo, we've intentionally designed Passport to not rely *at all* on Envoy.
You can update firmware from any phone or computer by downloading (and optionally verifying) firmware directly from GitHub, you can connect and use any wallet you want that supports our open standards (a very long list!), and can choose to never download or use Envoy without sacrificing any functionality.