[thelist] Spiders and things

[Matt Warden]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Ken Moore wrote:
> Hi all,
> 
> Matt Warden wrote:
>> How about... a friendly little search engine? You can access it at 
>> http://google.com :)
> 
> goolge.com, huh? Never heard of it :).
> 
> What I need is a way to capture the info to a file. Google would work in a 
> pinch. But I want to automate the process if possible. At least, I have 
> heard that technology can sometimes help. Right?

You can use Google's api, or you could simply pipe the response to a file.

The point is, I would strongly suggest not spending a lot of time
finding/writing a generic spider when you can already query a rather
up-to-date index like Google.

- --
Matt Warden
Cleveland, OH, USA
http://mattwarden.com


This email proudly and graciously contributes to entropy.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.2 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFEu8UErI3LObhzHRMRApd+AJ9Y/vV7joeeZglkurBHcD3xqJoTCwCfRCUs
AwESQ8D4hEQtese8DRQsxio=
=s/+M
-----END PGP SIGNATURE-----