[thelist] incomplete spidering by Google?

Hassan Schroeder hassan at webtuitive.com
Fri Sep 17 15:14:09 CDT 2004


I have a relatively new site up, the GoogleBot's swung by and picked
up some top-level pages, but not followed the links on them; is that
typical?

An example of a page that was found is:

   <http://glimmerdream.com/color/intro>

:: which has links to /color/red, /color/blue, etc. but none of them
seem to have been visited.

Any thoughts?

-- 
Hassan Schroeder ----------------------------- hassan at webtuitive.com
Webtuitive Design ===  (+1) 408-938-0567   === http://webtuitive.com

                           dream.  code.




More information about the thelist mailing list