I created https://github.com/SeedSigner/seedsigner/issues/456 about this, but I failed to comprehend the code flow to get to the bottom of it. Hopefully someone more familiar with the code base can tke a look.
If anyone can point me to where it goes off the rails, I can pick this ticket up and try to make a code change, test it and submit a MR. 🙂