Yes, new vulnerabilities are discovered against secure elements, and then attackers iterate towards making those vulnerabilities cheaper and cheaper to exploit. Once an SE is sufficiently pwnd, you will feel compelled to upgrade to the new hotness. Or you get tired of that, bang a seed into steel, secure it, store the seed passphrase separately, and have a SeedSigner handy.