[thelist] My first Robot

Arlen.P.Walker at jci.com Arlen.P.Walker at jci.com
Tue Jul 23 11:38:01 CDT 2002


> I asked the client about asking the 13 sites if they would mind but he is
> uncertain because if they do mind then what do we do?

Just be sure to follow the robots exclusion protocol:

http://www.robotstxt.org/wc/exclusion.html

Have fun,
Arlen
Chief Managing Director In Charge, Department of Redundancy Department
DNRC 224

Arlen.P.Walker at JCI.Com
----------------------------------------------
In God we trust; all others must provide data.
----------------------------------------------
Opinions expressed are mine and mine alone.
If JCI had an opinion on this, they'd hire someone else to deliver it.




More information about the thelist mailing list