[thelist] Hide entire directory from search engines?

Gersten, John JGERSTEN at lchb.com
Fri Mar 28 14:01:36 CDT 2008

I'm pretty sure there's a way to hide an entire directory from search engines, but I'm having a stupid attack and can't recall it. Does anyone know of a way to conceal entire directories from crawlers, etc.? I know I could put my files "above" the visible website, but if possible I'd prefer to avoid doing that and just hide one particular directory from search engines, crawlers, etc.

Thanks in advance,


More information about the thelist mailing list