[thelist] Sample of the error log THE ANSWER? v2

[John C Bullas]

At 19:07 19/10/2003, John C Bullas wrote:
>At 18:26 19/10/2003, Sylvia Braunstein wrote:
>>Here is a SMALL sample of the log i get:
>>
>>[Sun Jul  6 19:43:26 2003] shpd: access to
>>/ch/files4.rt/000/rugged.com/web/robots.txt failed for 66.196.65.40, reason:
>>no file matching URI: /robots.txt from -
>
>if you have no robots.txt file it will say so , one is not ESSENTIAL but 
>useful if you believe spiders take any notice of instructions whereto look 
>and where not to look ;)
>
>
>>[Sun Jul  6 23:36:29 2003] shpd: access to
>>/ch/files4.rt/000/rugged.com/web/pictures/spacer.gif failed for 68.12.0.48,
>>reason: no file matching URI: /pictures/spacer.gif from
>>http://www.rugged.com/site/mainbooth.html

Sylvia

In looking for spacer.gif..........

http://www.rugged.com/webimages/

is full of pictures and subdirectories!!!!

http://www.rugged.com/webimages/pictures/

http://www.rugged.com/webimages/pictures/space.gif ??????

suggest you block indexing of this directory or plop a index.htm page in there?

FB
(this end towards enemy)