There was a small but significant number of URLs that were discarded without trying because they were unroutable, including bare host names, localhost, .local and .private domains, IP address ranges that were for private use, and broadcast (!) IP addresses.