[thelist] Some questions on the robots.txt file

Daniel J. Cody djc at starkmedia.com
Mon Jul 16 10:27:43 CDT 2001


Each unique hostname(foo.bar.com foo1.bar.com etc..) should have its own 
robots.txt file, and one will do fine

Master Web & Master Host wrote:

> Morn' gang:
> 
> I have hopefully not dumb question on the robots.txt file: AFAIK I need to
> set up only file for my site. That's clear as mud - but: Do I need also
> only one file for my subdomains?






More information about the thelist mailing list