[thelist] loopy URLs produced by search engines

[Shashank Tripathi]

Hi Tony,


    | heres a free search engine for your site that does
    | highlight words. http://www.fluffy.co.uk/fs/


Their demo search doesn't result in anything for words like "fluffy",
"frame", "site" etc. Does it really work? :)

Another good script is www.kscripts.com 's ksearch.

Meanwhile, HTDIG is one of my favorites (and perhaps among the better
know ones) because it crawls your website as a real search engine would
-- by "visiting" your website from a "starting URL". It supports
robots.txt etc and more features than any other freebie script. Its also
a cinch to install and get working. Above all, their indexer is not as
CPU-intensive as some of the other free scripts. For the curious:
http://www.htdig.org/require.html


Shashank

--
Shashank Tripathi
www.shanx.com