For clearnet IPv6, that could be an issue. But just as with IPv4 - use a VPN if you want to obscure your IP. The Linux IP6 stack will listen on a stable IP, but make outgoing connections on a random one that changes periodically. So at least that obscures which machine on the LAN is making to connection.