[thelist] Can the Search Engines find an unlinked page?

Hassan Schroeder hassan.schroeder at gmail.com
Tue Jul 15 13:30:59 CDT 2008


On Tue, Jul 15, 2008 at 11:11 AM, Jeff Hinds <jeff.hinds at netagency.com> wrote:
> You can excluded the search engines from indexing those directory using a
> robots.txt file.

..and the Bot Fairy will leave a euro under your pillow for every
truly sensitive directory you list in it...   :-)

-- 
Hassan Schroeder ------------------------ hassan.schroeder at gmail.com



More information about the thelist mailing list