[thelist] pulling in an entire website

Peter VanDijck pvandijck at lds.com
Tue Oct 29 09:21:01 CST 2002


Here's my problem: I want to pull in intranets. A lot of the content is
dynamically generated (database stuff), so pulling in files from a server
doesn't work, I need to pull in the website as rendered through http. I also
have access issues (cookies): often only registered users can view these pages
so the tool needs to simulate being a user.
Any tips?
Peter

Anderson Cummins wrote:

> Have you tried wget? This can be pointed at a website and can mirror all the
> content locally.




More information about the thelist mailing list