You’re just viewing a sum of the addresses generated by the wallet’s xpub. If you want to “watch” the wallets balance from hardware that isn’t tied to your storage method.

This is why sharing your xpub will dox the entire wallet.