[thelist] Another way of trapping bots (was: Congrats toevolt.org....)

Don Makoviney don at aspalliance.com
Fri Sep 21 22:12:41 CDT 2001


Is there an article or resources somewhere online for how to trap bots that
ignore robots.txt files? If it matters, an NT/2000 based one would be most
relevant to me.

Thanks,

Don Makoviney
MAKOVISION.com - Handpicked News For Internet Developers
http://www.makovision.com/

FREE Usability/WebDev Newsletter - Twice Weekly
http://www.makovision.com/subs/






More information about the thelist mailing list