If you're just going across the border, or somewhere else. extremely easy. IMO
Discussion
Biggest risk imo is having the hardware wallet and seed phrase on you at the same time. Getting on a plane, if they recognize what it is, you could lose it all.