Not exactly as data usually relays, but use a VPN if you are worried. Tbh people that raise this point are you not worried about other apps too? and already use a VPN?
Also are you not concerned ips are not being logged at the network level up stream from signal because that is literally what the NSA does