On Sun, 16 Nov 2003 15:44:57 -0800, Diane Soini <dianesoini at earthlink.net> wrote: > How well is the robots.txt file obeyed? This might help with the answer: http://www.fleiner.com/bots/ ;o) Tony