[thelist] Lucene with MySQL and .net

[Volkan Özçelik]

Hi list,

An Asp.net MySQL application I currently requires a serch module.
I tried MySQL full text indexing but observed an unaccaptable performance
degredation.

The site receives aroun 9 to 12 thousand unique visitors daily, and the last
thing I want the search functionality to cause a bottleneck.
Buying hardware (additional RAM, a server with quad cpu, moving the DB tier
to a separate server on its own etc etc) could obviosly sort it out, but
that's currently not an option.

Hence have several choices I believe:

- Optimize mySQL queries, which will boil down to search less data, do
lesser joins etc -- which I do not want,
- cache search results -- which will take some time to properly architect,
- or use Apache Lucene as the full text search engine.

As far as my research is concerned, Lucene is several times faster than
mySQL full text search.

My question is: what is the best practice in using Lucene along with a DB
Tier?

Shall I
- create static files that I pull out from the db
- store them somewhere
- index those files with lucene periodically
- and use lucene to search those static indexes.

Or is there an easier way around?

Any pointers would be greatly appreciated.

Thanks in advance,
-- 
Volkan Ozcelik
+> linkibol.com - in seek for quality links : http://www.linkibol.com/
+> Going solo in Turkish: http://www.fikribol.com/donkisot/
+> My projects/studies/trials/errors : http://www.sarmal.com/
+> Sardalya JavaScript Library: http://www.sarmal.com/sardalya/