Yes, absolutely.

And the part that would worry me is if something would happen to me and my wife would need to retrieve the funds.

Which would mean that I would need to leave instructions (including seed, pin, passphrase, etc.) that were secure but also something that she could take to a trusted friend and they could help extract the funds.