What you're describing is the simple concept of a social graph. Those three letter agencies could gain a list of contacts for who knows who from services like Google, but if you have PNP in Signal set in such a way where discoverability is set to no one, how would even the three-letter agencies know that you're using Signal?