Archive.org and robots.txt

Posted by k | Posted in Uncategorized | Posted on 02-07-2007

I am not saying you’re one of those black hat webmasters who have reached PR6 due to heavy link spamming building and stuff.

However, and in case you have a friend that fits that category && in case he is trying to push sale the domain name he used to an moron investor, here’s some nice tip I learned recently it works:

The sooner the better, add a line to your robots.txt file to block archive.org bot.

No archive, no take-me-back machine, no domain name criminal record! ;)

Comments (3)

  1. Ohh.. That’s low lol :P

  2. You are really evil. And I am liking it! Keep up the good work! I just happen to have “a friend” that enjoys this advice…

  3. How to block archive.org robot???
    Is archive.org close related to Alexa?

Post a comment