[analog-help] Could not generate statistics for larger files!

[Aengus]

On Friday, October 13, 2006 1:08 PM [EDT],
Jagadish <jmaripi at cs.siu.edu> wrote:

>> I like the features of analog and I was using analog to generate the
>> statistics of the log files generated by Apache web server. It
>> generated the results for smaller size say less than 2 MB. I tried
>> to run the analog by giving a log file of size 993 MB and it didn't
>> produce any results. It kept running for more than 5 hrs. Then I
>> tried to filter the log of a single month into one file. It was of
>> size about 108 MB and I gave this to Analog. Analog kept running for
>> more than 4 hrs but didn't generate any log file.
>>
>> The "errors.txt file" just contains the following text:
>>
>> C:\analog 6.0\analog.exe: Warning F: DNS lock file C:\analog
>> 6.0\dnslock
>>
>>  already exists: backing off to DNS LOOKUP
>>
>> I used analog for generating the statistics on log files of IIS
>> server on windows 2003. It generated them. I didn't try for larger
>> files tough. I don't think it is due to the configuration file
>> because analog was working with smaller log files with similar
>> configuration. I would appreciate if anyone can provide me some
>> information about the behavior of analog on larger files.

http://analog.cx/docs/dns.html

DNS lookups are slow and Analog does them one at a time. If you turn off DNS 
lookups, your 993MB logfiles should be processed in a matter of minutes.

If you want to do DNS lookups, it is recommended that you use one of the 
many DNS helper applications - http://analog.cx/helpers/index.html#dns

Aengus