[thelist] Robots.txt

Jay Fitzgerald jayfitz at bayou.com
Mon Dec 4 17:19:37 CST 2000


what do you think of just having an empty robots.txt file? That is what
I usually use, a 0 byte file with nothing in it at all. It eliminates
the 404 error but are there any downsides?

--
Jay Fitzgerald - N at ta$ - Internet Director
===================================
Digital Athlete Gamers League   http://www.dagl.net
===================================
ICQ: 38823829






More information about the thelist mailing list