lr_xml2report merge problem

[Joost van Baal]

Hi,

Op do 30 mrt 2006 om 10:04:33 +0100 schreef Shakeel Suffee:
> Joost van Baal wrote:
> >Op do 30 mrt 2006 om 09:28:45 +0100 schreef Shakeel Suffee:
> >>
> >>I am having some problems when trying to merge xml reports. Below are 
> >>the commands and sample output. First I converted my exim logs into xml 
> >>reports and then merged the reports.
> >>
> >># lr_log2report -o xml exim exim_mainlog.03.gz repxml03.xml
> >>Log file was compressed using gzip.
> >>Decompressing log file using /bin/gzip...
> >>Parsing log file using exim DLF Converter...
> >>Extracted 17745 DLF records on 76829 lines.
> >>Encountered 0 errors and ignored 0 lines.
> >>Running analysers...
> >>Generating XML report...
> >>Formatting report as xml in repxml03.xml...
> >>
> >>###############
> >>
> >>This is an output of the part of the report causing the problems
> >>
> >>Delay                                                 Deliveries % Total
> >>----------------------------------------------------- ---------- -------
> >>[0s-1s>                                                    23346    39.6
> >>[1s-6s>                                                    27011    45.8
> >>[6s-31s>                                                    4182     7.1
> >>
> >>##############
> >>
> >>#lr_xml2report -o xml --template email_default --merge repxml02.xml 
> >>repxml03.xml > repxmlcat.xml
> >>Merging reports 'repxml03.xml', 'repxml02.xml'...
> >>lr_xml2report: WARNING invalid number of names for a rangegroup 
> >>subreport: 0
> >>
> >>lr_xml2report: WARNING Merge of 'deliveries-by-size.0' failed at 
> >>/usr/local/share/perl5/Lire/ReportConfig.pm line 794.
> >>
> >>lr_xml2report: WARNING incompatible merge: source range is splitted 
> >>across target ranges: [1,6> : end=5
> >>
> >>lr_xml2report: WARNING Merge of 'deliveries-by-delay.0' failed at 
> >>/usr/local/share/perl5/Lire/ReportConfig.pm line 794.
> >>
> >>lr_xml2report: WARNING invalid number of names for a rangegroup 
> >>subreport: 0
> >>
> >>lr_xml2report: WARNING Merge of 'deliveries-by-size.0' failed at 
> >>/usr/local/share/perl5/Lire/ReportConfig.pm line 794.
> >>
> >>lr_xml2report: WARNING incompatible merge: source range is splitted 
> >>across target ranges: [1,6> : end=5
> >>
> >>lr_xml2report: WARNING Merge of 'deliveries-by-delay.0' failed at 
> >>/usr/local/share/perl5/Lire/ReportConfig.pm line 794.
> >>
> >>Formatting report as xml in -...

I've received your sample logfile, and I'm able to reproduce the
problem.  Thanks.

What happens is:

----------------------

joostvb at nagy:~/tmp/Shakeel% lr_xml2report -o xml --template \
email_default --merge repsam.10 repsam.20 > repsam.xml.new
Merging reports 'repsam.20', 'repsam.10'...
lr_xml2report: WARNING invalid number of names for a rangegroup
subreport: 0

lr_xml2report: WARNING Merge of 'deliveries-by-size.0' failed at
/usr/share/perl5/Lire/ReportConfig.pm line 794.

lr_xml2report: WARNING incompatible merge: source range is splitted
across target ranges: [1,6> : end=5

lr_xml2report: WARNING Merge of 'deliveries-by-delay.0' failed at
/usr/share/perl5/Lire/ReportConfig.pm line 794.

lr_xml2report: WARNING incompatible merge: source range is splitted
across target ranges: [6144,31744> : end=25600

lr_xml2report: WARNING Merge of 'deliveries-by-size.0' failed at
/usr/share/perl5/Lire/ReportConfig.pm line 794.

lr_xml2report: WARNING incompatible merge: source range is splitted
across target ranges: [1,6> : end=5

lr_xml2report: WARNING Merge of 'deliveries-by-delay.0' failed at
/usr/share/perl5/Lire/ReportConfig.pm line 794.

Formatting report as xml in -...

----------------------

Let's see...

repsam.10 features:

 <lire:name col="rangegroup:size" value="6144" range="25600">[6k-31k></lire:name>

(i.e. [6144 - 31744>) which translates to

  Deliveries Attempts By Size

  Size                       Deliveries % Deliveries Volume % Volume
  -------------------------- ---------- ------------ ------ --------
  [6k-31k>                            3        100.0  47.9k 100.0
  -------------------------- ---------- ------------ ------ --------
  Total for 3 records                 3        100.0  47.9k 100.0


repsam.20 features:

 <lire:name col="rangegroup:size" value="31744" range="128000">[31k-156k></lire:name>

(i.e. [31744 - 159744>) which translates to

  Deliveries Attempts By Size

  Size                       Deliveries % Deliveries Volume % Volume
  -------------------------- ---------- ------------ ------ --------
  [31k-156k>                          1         50.0 138.8k 100.0
  -------------------------- ---------- ------------ ------ --------
  Total for 2 records                 2        100.0 138.8k 100.0


Since Lire apparently isn't able to merge these figures, the "Deliveries
Attempts By Size" report is skipped when merging.

In /usr/share/lire/templates/email_default.xml these reports are tuned:

            <param name="email:deliveries-by-size">
              <param name="id">deliveries-by-size.0</param>
              <param name="size">1k</param>
            </param>

Setting this size parameter to e.g. 1m, you might end up with compatible
ranges.  If you supply bigger logfiles, you might be lucky too.

See also the "Gotchas" notes in the "Merging Reports" section in the
Lire User's Manual, online at
http://download.logreport.org/pub/current/doc/user-manual/ch03s04.html .

I don't yet fully understand what's causing Lire to give up here.  I
might be able to find out more later.

Bye,

Joost

-- 
.    .                                        http://logreport.com/
| '.|                        /^LogReport$/
| Lire                                        http://logreport.org/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 829 bytes
Desc: Digital signature
Url : http://lists.logreport.org/pipermail/questions/attachments/20060330/5c0d6683/attachment.bin