It's like with Google image search. The crawlers go over the whole Internet, suppress obvious kiddie porn and other horrendous stuff, and then add safe-search options for people who want to search for "Europe through the back door" and get Rick Steve's travel guide as the first result.