But do you really think the crawlers, spiders or whatever we call them are all respecting the robot.txt ?
I am a firm believer your old blogs are still hiding somewhere in the abyss of the WWW
But do you really think the crawlers, spiders or whatever we call them are all respecting the robot.txt ?
I am a firm believer your old blogs are still hiding somewhere in the abyss of the WWW
No replies yet.