[thelist] What search bots follow [was: Gray Hairs - Google Mini]

Ian Anderson ian at zstudio.co.uk
Thu Feb 16 06:20:49 CST 2006


kasimir-k wrote:
> But why doesn't it follow the links then? Any
> ideas?

I met someone from (what seems a contradiction in terms) a reputable SEO 
company, who are Google partners. He explained that this is normal 
practice, and that new sites are indexed gradually over a period of 
time. Guessing at the reason, I think this is to reduce the load on the 
crawler, so all new URLs are added to the index as rapidly as possible, 
but without depth, and the depth gets added thereafter as a series of 
lower priority passes.

What you say corroborates what he said, which is interesting.


-- 
_________________________________________________
zStudio - Web development and accessibility
http://zStudio.co.uk

Snippetz.net - Online code library
File, manage and re-use your code snippets & links
http://snippetz.net




More information about the thelist mailing list