[thelist] Crawling for headers

[Peter Johansson]

On Tue, 19 Mar 2002, Tony Crockford wrote:

> >Anyone knows of such a tool?
>
> This might be a *sledgehammer to crack a nut* but would an open
> source search engine do the job?
>
> http://www.htdig.org
>
> IIRC you could probably configure the indexing part of it to do the
> job?
>
> maybe?  maybe not.....

Thanks for the tip, I'll start with investigating what our search engine
already in place can handle. I think such functionality should be there
since it already crawls on the intranet.

But thanks again,
Peter