[thelist] Local Storage of RSS

[Seth Fitzsimmons]

Hi.

Looking for some feedback (experience-based or inspirational).

How would you store large numbers (500,000+) of RSS documents for 
periodic local parsing or serving?

Option 1: keep them as individual files, preferably in an organized 
directory tree.
Pros: established method
Cons: potential for running into filesystem limits

Option 2: As BLOBs in a relational database (despite the content of the 
RSS files not being relational).
Pros: established method
Cons: RDBMS overhead

Option 3: In an XML database, e.g. Xindice.
Pros: designed for structured content, some allow XPath querying
Cons: unproven

Special note on option 3: does anyone have experience with this category 
of products?

seth