On Fri, Mar 28, 2008 at 12:01 PM, Gersten, John <JGERSTEN at lchb.com> wrote: > Does anyone know of a way to conceal entire directories from crawlers, etc.? Password protecting it would be one, since robots.txt is only a serving suggestion :-) -- Hassan Schroeder ------------------------ hassan.schroeder at gmail.com