[thelist] pulling in an entire website

Kevin p+evolt at redbrick.dcu.ie
Mon Nov 4 09:27:01 CST 2002


Yep,

And wget does that,
which is prolly why it was suggested.

"wget --load-cookies file"
will do the trick.

Just nab the cookie file generated by Mozilla or Netscape iirc.

- Kevin

On Tue, Oct 29, 2002 at 10:20:20AM -0500, Peter VanDijck wrote:
> Here's my problem: I want to pull in intranets. A lot of the content is
> dynamically generated (database stuff), so pulling in files from a server
> doesn't work, I need to pull in the website as rendered through http. I also
> have access issues (cookies): often only registered users can view these pages
> so the tool needs to simulate being a user.
> Any tips?
> Peter
>
> Anderson Cummins wrote:
>
> > Have you tried wget? This can be pointed at a website and can mirror all the
> > content locally.
>
> --
> For unsubscribe and other options, including
> the Tip Harvester and archive of thelist go to:
> http://lists.evolt.org Workers of the Web, evolt !



More information about the thelist mailing list