[thelist] search engine spidering of piggy-backed domains

Jacob Metcalf jmetcalf at northsound.net
Tue Sep 24 16:52:00 CDT 2002


No most search engines will start in the front page and follow all
the text based links. Flash and Javascript based links are ignored.
If you have a link to them they will get indexed. If you have content
you are trying to hide from Google. you should put a no robots meta
tag in your head tag.
Jacob Metcalf
http://www.8bitjoystick.com/ Press Start to Play

==============================================
Webmail Provided by NorthsoundNet Internet Services *** Western
Washington's Local Internet Provider ***  http://www.Northsound.net




More information about the thelist mailing list