What hardware wallet and app interface are you using?
You should be able to load up the xpub address in an app like sparrow (for Mac/pc) or nunchuk for mobile, and you can derive addresses that way without having to reconnect everytime.
Discussion
Trevor and their Trevor suite. I've got an old computer I plan on installing Linux and making a node but haven't gotten around to it. The previous old computer running windows server was my node but it died