The age of Internet Chivalry is dead. Nobody respects robots.txt anymore.
Please Login to reply.
Now robots pretend to be human, clicking around and all.
