[thelist] What search bots follow [was: Gray Hairs - Google Mini]
Ian Anderson
ian at zstudio.co.uk
Thu Feb 16 06:20:49 CST 2006
kasimir-k wrote:
> But why doesn't it follow the links then? Any
> ideas?
I met someone from (what seems a contradiction in terms) a reputable SEO
company, who are Google partners. He explained that this is normal
practice, and that new sites are indexed gradually over a period of
time. Guessing at the reason, I think this is to reduce the load on the
crawler, so all new URLs are added to the index as rapidly as possible,
but without depth, and the depth gets added thereafter as a series of
lower priority passes.
What you say corroborates what he said, which is interesting.
--
_________________________________________________
zStudio - Web development and accessibility
http://zStudio.co.uk
Snippetz.net - Online code library
File, manage and re-use your code snippets & links
http://snippetz.net
More information about the thelist
mailing list