Memory consumption problem

Joost van Baal joostvb at logreport.org
Wed May 4 11:06:30 CEST 2005


Hi Arunas,

[CC-ing the public questions-list, after ack from Arunas on IRC.]

On Wed, May 04, 2005 at 11:24:45AM +0300, Arunas Pranckevicius wrote:
> 
> I am using lire 2.0.1 for our servers log analysis

On GNU/Linux, you wrote on IRC.

> and encountered one
> problem:
> 
> When using it on out central syslog server,  lr_log2report parses 151 mb
> sized syslog file and
> takes all server memory (500Mb RAM plus huge swap) when using syslog
> parser.
> The server freeze when go out of free RAM and it work all time with swap
> then.
> 
> Is any way to limit used memory for lire?

There has been a private discussion among Lire developers, ( Message-ID:
<4136DEB9.3000709 at nlnet.nl>, Date: Thu, 02 Sep 2004 10:50:01 +0200 )
about Lire performance.  It's believed the bottleneck is in the dfl2xml
phase, and performance might be strongly related to the specific
subreports used.  So, you might gain a lot by disabling some subreports
you're not interested in anyway.

I remember there is some setting, to toggle between disk- and
memory-consumption.  Wytze, Francis: is this toggle removed in some
previous release?

Furthermore, it _might_ be 150MB log needs 500MB memory.  I hope others
will join this discussion...

> By the way, this tool is great and saves alot of time when parsing
> multiple logs.. :-)

Cool :)

Bye,

Joost

-- 
.    .                                        http://logreport.com/
| '.|                        /^LogReport$/
| Lire                                        http://logreport.org/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: Digital signature
Url : http://lists.logreport.org/pipermail/questions/attachments/20050504/ab270ad6/attachment.bin 


More information about the Questions mailing list