[thelist] Can the Search Engines find an unlinked page?

Jeff Hinds jeff.hinds at netagency.com
Tue Jul 15 13:11:34 CDT 2008


You can excluded the search engines from indexing those directory using a
robots.txt file.

Learn more here:
http://www.robotstxt.org/ 

Jeff Hinds
http://www.netagency.com 
 

-----Original Message-----
From: thelist-bounces at lists.evolt.org
[mailto:thelist-bounces at lists.evolt.org] On Behalf Of evolt at brasscannon.net
Sent: Sunday, July 13, 2008 12:44 PM
To: thelist at lists.evolt.org
Subject: [thelist] Can the Search Engines find an unlinked page?

Quoth "Fred Jones" <fredthejonester at gmail.com>...

> I made a demo site called somesite.com/fred/
> 
> There no link anywhere in the world to that page--in fact that only
> people who ever saw it are me and my client. But he wants me now to
> remove it because he says the search engines will find it and list it.
> I am not opposed to removing it, but I think he's wrong. I see no way
> for any search engine ever to find it. Am I wrong?
> 
> Perhaps since he and I use gmail, Google is reading our email and
> thereby finds it?

No, it's much more straightforward and honest, depending on 
how your web server is configured.

See: "How Google indexed a file with no external link"
 http://seclists.org/bugtraq/2001/Jul/0174.html

 Summary:
 Apache 1.3.20 with Multiviews enabled allows remote requests to
 view directory contents and bypass the index page via a URL
 containing the "M=D" query string.

See what you get if you ask for http://somesite.com/fred?M=D

-- 

* * Please support the community that supports you.  * *
http://evolt.org/help_support_evolt/

For unsubscribe and other options, including the Tip Harvester 
and archives of thelist go to: http://lists.evolt.org 
Workers of the Web, evolt ! 




More information about the thelist mailing list