[thelist] Is there a tool to follow links and report them?
Paul Bennett
paul at teltest.com
Wed Feb 25 22:03:16 CST 2004
Diane Soini wrote:
> I know that you can download entire web sites, but what I want to do
> is not download a web site, but collect a list of all the links. Does
> a tool like this exist?
>
> The reason is that I need to put together a list of a bunch of
> multimedia presentations that are linked all over inside an intranet
> and a web site. Instead of copying and pasting and trying to search
> for them myself, I was wondering if there was some kind of tool that
> would crawl the web site and collect all the URLs. Even better would
> be if it would remove duplicates and/or allow me to put in a regexp to
> be more selective.
xenu link checker will spider a site and list all the outgoing (external
links) - it is free, fast and accurate - worth looking at it
http://home.snafu.de/tilman/xenulink.html
More information about the thelist
mailing list