[thelist] Search engines and dynamic sites using query strings

Oliver Lineham oliver at lineham.co.nz
Sat Feb 3 20:16:37 CST 2001

At 09:43 1/02/2001 -0600, you wrote:

[404 header from evolt]
>but for browsers other than wack combos of IE and windows, it isn't a problem.

if evolt.org is sending 404 headers, that causes big problems for search 
engine indexing.  search engines generally refuse to index pages that give 
404 headers - they delete the URL from the index, in fact.

we've been running the new site long enough that altavista *should* by now 
be indexing articles with the new URLs.


list shows all AV indexed pages on evolt.org (not counting 
lists.evolt.org). it totals 8 pages, none of which have the new URL scheme.

i also can't find any new-URL pages indexed by www.google.com:

lists 46 pages, none of which are the new-URL scheme. notice that almost 
all of them show the page title as "Update your bookmarks! - evolt.org" yet 
the new pages aren't indexed. so the crawler has been here at least.

returning a 404 header completely negates the SE benefits of a 
query-string-less URL scheme.



  phone +64 21 210-7845       http://www.vibe.co.nz/
  po box 10-492              wellington, new zealand

More information about the thelist mailing list