[thelist] Re: [SPIDERS] Can Dynamic pages be crawled?
Cayley Vos
cvos at netpaths.net
Fri Nov 22 15:42:01 CST 2002
Yes, spiders can crawl dynamic sites. However, will they list you in the
SERP's (Search Engine Results Page)? That depends on how you set your site
up.
Using server technology, create pages that are search engine AND user
friendly.
Instead of page.php?site=business&db=223&this=that
Create pages like /page/business/site
This can be done in apache using mod_rewrite and in IIS using a similar
parameter.
Read more here:
http://www.ask-marketing-experts.com/showthread.php3?s=&threadid=272
On 11/22/02 9:08 AM, "thelist-request at lists.evolt.org"
<thelist-request at lists.evolt.org> wrote:
> On a site with lots of dynamic content being pulled from the datatbase, can
> these pages be crawled by spiders?
>
> I remember reading about the url itself may cause the problem?
>
> Benjer
Cayley Vos, Principal
office: 310-372-3086
cell: 360-303-0150
http://netpaths.net
_______________________________________________________
web hosting | search engine marketing | web development
More information about the thelist
mailing list