[thelist] Searchable dynamic content

Dave W dw at clara.co.uk
Wed Jan 9 17:58:58 CST 2002


I was just going to ask you how long had your dynamic page been up? It may
be that Google has not spidered the new page.

Have you checked your web logs to see when Google last visited your site?
Google uses a webcrawler called "Googlebot" that should show up in the
user-agent field.

A search for "NCPR Regional News" does return the news page for December 6

Google has a piece on "My Web Pages Are Not Currently Listed" at

You might find these useful...


> -----Original Message-----
> From: thelist-admin at lists.evolt.org
> [mailto:thelist-admin at lists.evolt.org]On Behalf Of Bill Haenel
> Sent: 09 January 2002 23:44
> To: thelist at lists.evolt.org
> Subject: RE: [thelist] Searchable dynamic content
> > Hmmmm.... I dunno if that's it... for example, this page:
> >
> > http://www.gsnet.com/servlet/Hierarchy/Equipment/Crawler_Tractors/
> > All/All/Al
> > l/Manufacturer/hierarchy.html
> >
> > (watch for line wrap) which gets rendered every request (by spiders or
> > otherwise) always gets indexed by Google... in fact, those are
> > even virtual
> > directories - none of them exist... they're just for Java to use...
> My expectation was that a spider would crawl through the HTML generated by
> the PHP, and that's the content that would be indexed. However, what I've
> found is that the static content has been indexed, but the
> dynamic has not.
> Granted, the page has only had dynamic content for a short time,
> and perhaps
> has not been crawled since its integration(?).
> BH
> --
> For unsubscribe and other options, including
> the Tip Harvester and archive of TheList go to:
> http://lists.evolt.org Workers of the Web, evolt !

More information about the thelist mailing list