Nope. The account structure means that they can't be spent together easily. The only privacy risk is seed being compromised, but at that stage you've got bigger problems!