[thelist] Another way of trapping bots (was: Congrats toevolt.org....)

Paola Kathuria paola at limitless.co.uk
Fri Sep 21 19:02:41 CDT 2001


"Warden, Matt" wrote:
> Sessions rely on cookies, right?

Not necessarily.

The Colour Selector (and other interactive sites on that server)
maintains sessions at the server.

Even if you don't have a generated site, you can still make use
of this kind of trap by extracting accesses to the trap page
from your logs to maintain your own list of robots.  I mostly
use my bot list to grep out spiders/bots from access logs so
that I can get an idea of actual interest by humans (I also
grep logs for accesses to robots.txt) (although in the past
few days, I've seen 20 times more accesses by NT hacking attempts
than by humans to some of my sites).


Paola, who added "flunky" to the list today




More information about the thelist mailing list