[thelist] Search Engine Identifiers
.jeff
jeff at members.evolt.org
Mon Sep 10 12:38:13 CDT 2001
frank,
><><><><><><><><><><><><><><><><><><><><><><><><><><><><><
> From: Frank
>
> Does anyone have a list of how the popular search
> engines refer to themselves when making an HTTP call?
><><><><><><><><><><><><><><><><><><><><><><><><><><><><><
http://www.spiderkb.com/spider_id.cfm
><><><><><><><><><><><><><><><><><><><><><><><><><><><><><
> I want to add some conditions in my application file
> that will redirect certain users (engines) to my data
> in ways that will be formatted in an indexing friendly
> way.
><><><><><><><><><><><><><><><><><><><><><><><><><><><><><
be careful what you do [with|to] these spiders. some will not be forgiving
of giving them data tailored for engines. they've gotten wise to people
trying to use these techniques to improve their own listings. any reason to
not just make your site(s) more se-friendly in the initial design? a nice
side-effect is that doing so often makes your site more user-friendly as
well.
thanks,
.jeff
http://evolt.org/
jeff at members.evolt.org
http://members.evolt.org/jeff/
More information about the thelist
mailing list