[thelist] incomplete spidering by Google?

Bob Easton bob at eleaston.com
Sat Sep 18 04:48:42 CDT 2004


Hassan Schroeder wrote:

> I have a relatively new site up, the GoogleBot's swung by and picked
> up some top-level pages, but not followed the links on them; is that
> typical?
> 
Very typical with any search engine spider. It will be back frequently, 
crawling a bit deeper each time.

-- 
Bob Easton


More information about the thelist mailing list