I've seen too many stories like this that end tragically. It's why I don't recommend passphrases: they result in a brittle 2-of-2 key architecture.