[thelist] How does Google access protected sites

Wahyu Harsono php at erasinar.com
Tue Aug 13 22:52:01 CDT 2002


Google / GoogleBot Could Not Type Pass And UserName, They Could Not Crawl
Those Page..

Thx

----- Original Message -----
From: "Feingold Josh S" <Josh.S.Feingold at irs.gov>
To: <thelist at lists.evolt.org>
Sent: Tuesday, August 13, 2002 11:11 PM
Subject: [thelist] How does Google access protected sites


> --
> [ Picked text/plain from multipart/alternative ]
> I noticed that Google gets access to sites that usually need a username
and
> password to enter.  Does anyone know how Google manages to do this?
>
> Josh
> --
> For unsubscribe and other options, including
> the Tip Harvester and archive of thelist go to:
> http://lists.evolt.org Workers of the Web, evolt !
>
>





More information about the thelist mailing list