Biggest risk imo is having the hardware wallet and seed phrase on you at the same time. Getting on a plane, if they recognize what it is, you could lose it all.