[thelist] Search Engine Identifiers

.jeff jeff at members.evolt.org
Mon Sep 10 12:38:13 CDT 2001


frank,

><><><><><><><><><><><><><><><><><><><><><><><><><><><><><
> From: Frank
>
> Does anyone have a list of how the popular search
> engines refer to themselves when making an HTTP call?
><><><><><><><><><><><><><><><><><><><><><><><><><><><><><

http://www.spiderkb.com/spider_id.cfm

><><><><><><><><><><><><><><><><><><><><><><><><><><><><><
> I want to add some conditions in my application file
> that will redirect certain users (engines) to my data
> in ways that will be formatted in an indexing friendly
> way.
><><><><><><><><><><><><><><><><><><><><><><><><><><><><><

be careful what you do [with|to] these spiders.  some will not be forgiving
of giving them data tailored for engines.  they've gotten wise to people
trying to use these techniques to improve their own listings.  any reason to
not just make your site(s) more se-friendly in the initial design?  a nice
side-effect is that doing so often makes your site more user-friendly as
well.

thanks,

.jeff

http://evolt.org/
jeff at members.evolt.org
http://members.evolt.org/jeff/






More information about the thelist mailing list