[thelist] Can the Search Engines find an unlinked page?

Fred Jones fredthejonester at gmail.com
Sun Jul 13 10:05:47 CDT 2008

> http://www.highrankings.com/forum/index.php?showtopic=36415&st=0&p=282378&#entry282378
> The long and short of it is that the apparently 'invisible' file may be
> findable and although good bots may honor robots.txt bad ones may not.
> Is there no honor in web world!!!

That question I could have answered for you before. Unfortunately not.
Not even close in fact, in many cases. :(

? As it happens setting up a simple
> password protection with .htpasswd and .htaccess for a single file or
> folder is an easy solution.  The thread goes into more detail.

Thank you.

More information about the thelist mailing list