[thelist] pulling in an entire website

[Jay Blanchard]

[snip]
Here's my problem: I want to pull in intranets. A lot of the content is
dynamically generated (database stuff), so pulling in files from a server
doesn't work, I need to pull in the website as rendered through http. I also
have access issues (cookies): often only registered users can view these
pages
so the tool needs to simulate being a user.
Any tips?
[/snip]

cURL - http://curl.haxx.se/

HTH!

Jay