[analog-help] OS unknown

[Aengus]

On Monday, July 24, 2006 8:36 AM [EDT],
Grace Sheu <gsheu at syrah.tunl.duke.edu> wrote:

> Please go to
>
> http://www.tunl.duke.edu/nucldata/Website_Report/June2006.html
>
> to see the full Browser Report.

It's pretty obvious that
Mozilla/5.0 (compatible; Yahoo! Slurp;
http://help.yahoo.com/help/us/ysearch/slurp)

is not being counted as a Robot.

You also need to add
PAGEINCLUDE *.pdf
PAGEINCLUDE *.shtml

so that your Page counts make more sense.

To get a list of the browsers that are falling into the "OS Unknown"
category, search and replace ROBOTINCLUDE to BROWREPEXCLUDE, and add
BROWREPEXCLUDE *Windows*
BROWREPEXCLUDE *Macintosh*
BROWREPEXCLUDE *Linux*
BROWREPEXCLUDE *SunOS*
BROWREPEXCLUDE *BSD*

The browsers that are left are the ones that make up OS Uknown.

Aengus



>
> Thanks.
>
> Grace
>
>
> On Mon, 24 Jul 2006, Aengus wrote:
>
>> On Monday, July 24, 2006 7:48 AM [EDT],
>> Grace Sheu <gsheu at tunl.duke.edu> wrote:
>>
>>> I trided the first step that you suggested. I uses ROBOTINCLUDE list
>>> to include more robots and re-ran one of my log. I thought I should
>>> see more "Known robots" numbers and less "OS unknown" number, but
>>> suprisedly in opposite; please see the following datas for details.
>>> Can you explain this?
>>
>> Not off hand. Unless you had a ROBOTINCLUDE for a local search
>> engine that you didn't include with the new list. It does seem odd
>> that the your original Robot count included so many requests rather
>> than pages - robots don't usually request images, so the pages count
>> for robots is usually much higher than the request count. In the
>> full Browser Report (rather than the Browser Summary) is there one
>> browser that made just 2855 requests?
>>
>>
>> To understand more about what is going on, you may need to use the
>> BROWEXCLUDE command, rather than the BROWREPEXCLUDE command. This
>> will allow you to totally exclude the requests from known browsers
>> from all the reports, so that you can use the Request Report to see
>> what files are being requested by the "OS Unknown" browsers, and you
>> can use the Host report to see where the requests are coming from.
>>
>> Aengus
>> +------------------------------------------------------------------------
>>>  TO UNSUBSCRIBE from this list:
>>>    http://lists.meer.net/mailman/listinfo/analog-help
>>>
>>>  Analog Documentation: http://analog.cx/docs/Readme.html
>>>  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
>>>  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general