[Mondrian] Performance: CellInfoPool

[Peter Tran]

ObjectPool performs a lot better than HashSet for the String test and
comparable for the Integer test.

Am I reading this wrong?

-----Original Message-----
From: mondrian-bounces at pentaho.org [mailto:mondrian-bounces at pentaho.org]
On Behalf Of Julian Hyde
Sent: Monday, August 13, 2007 6:06 PM
To: 'Mondrian developer mailing list'
Subject: RE: [Mondrian] Performance: CellInfoPool


This looks like a performance bug.

However, I ran some tests on ObjectPool using Integer and String values
and it looks competitive with HashSet in terms of speed. So I don't
think there's a performance bug in ObjectPool.

Can you confirm that this still occurs in 2.4? If so, please log a bug.

Julian

PS Here are the numbers. I added 300,000 entries to both an ObjectPool
and a HashSet, then did 700,000 retrieves. The density affected the
number of duplicate keys which were generated.

        // Key type:        Integer               String
        // Implementation:  ObjectPool    HashSet ObjectPool    HashSet
        //                  ========== ========== ========== ==========
        // With density=0.01, 298,477 distinct entries, 7,068 hits
        // 300,000 adds        221 ms      252 ms     293 ms    1013 ms 
        // 700,000 gets        164 ms      148 ms     224 ms     746 ms
        //
        // With density=0.5, 236,022 distinct entries, 275,117 hits
        // 300,000 adds        175 ms      250 ms     116 ms     596 ms
        // 700,000 gets        147 ms      176 ms     190 ms     757 ms
        //
        // With density=0.999, 189,850 distinct entries, 442,618 hits
        // 300,000 adds        128 ms      185 ms      99 ms     614 ms
        // 700,000 gets        133 ms      184 ms     130 ms     830 ms


> -----Original Message-----
> From: mondrian-bounces at pentaho.org
> [mailto:mondrian-bounces at pentaho.org] On Behalf Of Anton Nikitin
> Sent: Monday, August 13, 2007 9:19 AM
> To: 'Mondrian developer mailing list'
> Subject: [Mondrian] Performance: CellInfoPool
> 
> 
> Hi All.
> 
> It seems to me that CellInfoPool is too much slow on huge queries.
> 
> I use customized Mondrian version based on 2.3.2
> 
> When running a query which results in 300000 cells I'm observing that 
> CellInfoPool implementation is 10 times slower than CellInfoMap.
> 
> In my case I simply turned off CellInfoPool in all case
> (memory is less
> significant for us than performance). 
> 
> Anton
> 
> _______________________________________________
> Mondrian mailing list
> Mondrian at pentaho.org 
> http://lists.pentaho.org/mailman/listinfo/mondrian
> 

_______________________________________________
Mondrian mailing list
Mondrian at pentaho.org http://lists.pentaho.org/mailman/listinfo/mondrian


The information contained in this email may be confidential and/or legally privileged. It has been sent for the sole use of the intended recipient(s). If the reader of this message is not an intended recipient, you are hereby notified that any unauthorized review, use, disclosure, dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited. If you have received this communication in error, please contact the sender by reply email and destroy all copies of the original message. Thank you