[analog-help] robots

Aengus analog07 at eircom.net
Wed May 2 09:59:52 PDT 2007


sanders at charlottecountyfl.com wrote:
> i see there's a way to tell the Analog config file what browsers are
> actually robots.
> My question is, how do I know if my stats include traffic from
> robots. And how can I turn it off if it does?

The first thing to check for is if there are any requests for a file 
called /robots.txt in your logfile 
(http://en.wikipedia.org/wiki/Robots.txt). Well behaved robots check for 
it before spidering your site.

You can use HOSTEXCLUDE or BROWEXCLUDE to exclude all traffic from 
identified robots/spiders.

Aengus 





More information about the analog-help mailing list