Hardware wallets don't hold funds.
Seed that signs for uxtos is valid without passphrase
Adding a passphrase to that seed creates a separate set of entropy that is distinct, ie there will be no uxtos in that wallet
There is no way for the computer with the watch only to know your new passphrase xpub if it wasn't imported