[thesite] blocking user agents

Erik Mattheis gozz at gozz.com
Thu Mar 6 13:08:01 CST 2003


Hmm ... and no robots.txt file either.

About 6.5% of my page views in Feb came from unwanted robots, and that 
doesn't include ones that need to be blocked by IP.

It seems like these things might be worth looking into at a time when 
we're trying to tighten the belt ...

<http://www.evolt.org/article/Using_Apache_to_stop_bad_robots/18/15126/>
<http://diveintomark.org/archives/2003/02/26/>

On Thursday, March 6, 2003, at 09:35  AM, Dean Mah wrote:
> As far as I know we don't block agents.
>
> Dean
>
>
> On Thu, Mar 06, 2003 at 02:59:35AM -0600, Erik Mattheis wrote:
>> I've been obsessing over blocking user agents lately ... was wondering
>> if / what evolt.org has in place as far as banning the bad guys ...
>> would be interested in seeing a browser summary set to include as many
>> user agents as possible ... someone care to email one to me?

-----------------------
Erik Mattheis
GoZz Digital
<http://goZz.com/>
Flash and ColdFusion Development
Minneapolis, MN
-----------------------




More information about the thesite mailing list