[thelist] robots.txt

Hi Meredith,

You can use this format to disallow certain files:

Disallow: /dir/file.ext (for directories)
Disallow: /file.ext     (in the root)

Hope this helps :)

Gina



|-----Original Message-----
|From: thelist-admin@lists.evolt.org
|[mailto:thelist-admin@lists.evolt.org]On Behalf Of 
|Meredith Tupper
|Sent: Monday, December 20, 1999 9:07 PM
|To: thelist@lists.evolt.org
|Subject: [thelist] robots.txt
|
|
|Hi all,
|
|I'd like to set up a robots.txt file that will disallow
|access to php3 files.  I know how to disallow directories
|but I don't know how to disallow file types.  Does anyone
|have any suggestions or a sample robots.txt file I could
|pilfer?
|
|Thanks,
|Meredith
|
|<tip type = "sys admin"> According to The SANS (System
|Administration, Networking, and Security) Institute,
|December 24th is the peak of holiday hacker activity, so
|watch your logs accordingly. </tip>
|
|--
|Sometimes big things
|do come in small packages...
|PintSize Graphics & Web Hosting Inc.
|http://www.pintsize.com
|
|
|
|_______________________________________________________
|unsubscribe+options: 
http://lists.evolt.org/mailman/listinfo/thelist
tip harvester: http://lists.evolt.org/harvest/
email archive: http://lists.evolt.org/archive/
http://evolt.org/  Workers of the Web, evolt !