Jul
02
Archive.org and robots.txt
Posted by k | Posted in Uncategorized | Posted on 02-07-2007
I am not saying you’re one of those black hat webmasters who have reached PR6 due to heavy link spamming building and stuff.
However, and in case you have a friend that fits that category && in case he is trying to push sale the domain name he used to an moron investor, here’s some nice tip I learned recently it works:
The sooner the better, add a line to your robots.txt file to block archive.org bot.
No archive, no take-me-back machine, no domain name criminal record!


Ohh.. That’s low lol
You are really evil. And I am liking it! Keep up the good work! I just happen to have “a friend” that enjoys this advice…
How to block archive.org robot???
Is archive.org close related to Alexa?