[thelist] Identify a Web Crawler's request

David Travis dwork at macam.ac.il
Tue Jul 6 16:51:06 CDT 2004

Not at all, I wish the site to be indexed. If the visitors, who are not part
of my intended audience, "pass" the browser test they may browse the site
too (with limited access).

Thank you,

-----Original Message-----
From: thelist-bounces at lists.evolt.org
[mailto:thelist-bounces at lists.evolt.org] On Behalf Of Manuel Gonz?lez
Sent: Tuesday, July 06, 2004 10:33 PM
To: thelist at lists.evolt.org
Subject: RE: [thelist] Identify a Web Crawler's request

El mar, 06-07-2004 a las 22:41, David Travis escribió:
> Hi Josh,
> Thanks for your reply. Since this is a site which will service a specific
> set of users I can allow myself to limit them, and on the other hand offer
> them services, which are available for IE6 users only.

The 'will serve a specific set of users' requirement seems to be in
conflict with  the 'needs to be crawlable' one, doesn't it?

Manuel trabaja para Simplelógica, construcción web
(+34) 985 22 12 65         http://simplelogica.net 

* * Please support the community that supports you.  * *

For unsubscribe and other options, including the Tip Harvester 
and archives of thelist go to: http://lists.evolt.org 
Workers of the Web, evolt ! 

More information about the thelist mailing list