Yes but the new IP can be published "out of band". IP addresses (can) change rarely enough for that to be viable.

p2p networks like IPFS get bootstrapped by a couple of bootstrap peers only known by IP address.