[analog-help] robots
Aengus
analog07 at eircom.net
Wed May 2 09:59:52 PDT 2007
sanders at charlottecountyfl.com wrote:
> i see there's a way to tell the Analog config file what browsers are
> actually robots.
> My question is, how do I know if my stats include traffic from
> robots. And how can I turn it off if it does?
The first thing to check for is if there are any requests for a file
called /robots.txt in your logfile
(http://en.wikipedia.org/wiki/Robots.txt). Well behaved robots check for
it before spidering your site.
You can use HOSTEXCLUDE or BROWEXCLUDE to exclude all traffic from
identified robots/spiders.
Aengus
More information about the analog-help
mailing list