[analog-help] using cache files, REQUEST report too big

[Aengus]

On Thursday, August 09, 2007 11:12 PM [EDT],
Kevin Creason <ckevinj at gmail.com> wrote:

> I update the cache files at the end of month when we roll a new log.
> Our logs are ~1gb a month, so cache significantly helps.
>
> I have a wrapper script that I use to regenerate cache files with the
> new parameters when needed, and update on the first of a month. I was
> amused with 7day figure when it was working on older log files.
>
> Before the cache files, they were just boring independent monthly
> reports, no history between months. The cache is great, just getting
> there has been a challenge.

1G of logs a month will zip to about 50MB (and if it has any effect at all 
on performance, it will probably speed Analog up).

Cache files are fine for maintaining reports that you set up and designed 
originally with "real" data, because then your cache file can be built with 
the information that you know you need. If you create your cache file before 
you decide what you want to display in the reports, you are likely to have 
already discarded information that you need to make the reports accurate.

Aengus