[thelist] Re: [SPIDERS] Can Dynamic pages be crawled?

Cayley Vos cvos at netpaths.net
Fri Nov 22 15:42:01 CST 2002


Yes, spiders can crawl dynamic sites. However, will they list you in the
SERP's (Search Engine Results Page)?  That depends on how you set your site
up.

Using server technology, create pages that are search engine AND user
friendly.

Instead of page.php?site=business&db=223&this=that

Create pages like /page/business/site
This can be done in apache using mod_rewrite and in IIS using a similar
parameter.



Read more here:
http://www.ask-marketing-experts.com/showthread.php3?s=&threadid=272


On 11/22/02 9:08 AM, "thelist-request at lists.evolt.org"
<thelist-request at lists.evolt.org> wrote:

> On a site with lots of dynamic content being pulled from the datatbase, can
> these pages be crawled by spiders?
>
> I remember reading about the url itself may cause the problem?
>
> Benjer




Cayley Vos, Principal
office: 310-372-3086
cell: 360-303-0150
http://netpaths.net
_______________________________________________________
web hosting | search engine marketing | web development




More information about the thelist mailing list