[thelist] Avoiding logging of bots

M. Seyon evoltlist at delime.com
Thu Jul 6 19:03:10 CDT 2006


Message from Max Schwanekamp (7/6/2006 12:53 PM)
>No problem if it's a
>human, but robots in their multitudes can hit a link hundreds of times in a
>few minutes, and they generally don't accept cookies.

Can't you just use a robots.txt exclusion file to block access to that 
particular file?
http://www.robotstxt.org/wc/exclusion.html

I don't know how many robots obey it, but most of the well-behaved ones should.

regards.
-marc

--
Trinidad Carnival in all its photographic glory. Playyuhself.com
http://www.playyuhself.com/ 



More information about the thelist mailing list