[thelist] Is there a tool to follow links and report them?

Paul Bennett paul at teltest.com
Wed Feb 25 22:03:16 CST 2004

Diane Soini wrote:

> I know that you can download entire web sites, but what I want to do 
> is not download a web site, but collect a list of all the links. Does 
> a tool like this exist?
> The reason is that I need to put together a list of a bunch of 
> multimedia presentations that are linked all over inside an intranet 
> and a web site. Instead of copying and pasting and trying to search 
> for them myself, I was wondering if there was some kind of tool that 
> would crawl the web site and collect all the URLs. Even better would 
> be if it would remove duplicates and/or allow me to put in a regexp to 
> be more selective. 

xenu link checker will spider a site and list all the outgoing (external 
links) - it is free, fast and accurate - worth looking at it

More information about the thelist mailing list