[Mondrian] Testing a Hive dialect

Julian Hyde jhyde at pentaho.com
Thu Feb 10 11:14:57 EST 2011


I am well aware of the compromises with Hive. There is certainly an
impedance mismatch between hadoop and the real-time analysis, and that is
reflected in query response time. It is still useful  to have a Hive
dialect, because as you say, Hive is improving all the time. And Pentaho is
thinking about ways to bridge the impedance mismatch.
 
Can please you attach your code to the jira case as a patch? I will submit
it.
 
Also please attach the output of the test suite, and describe the version of
Hive you are running against. That will be a reference point for others who
are working on Hive.
 
Julian


  _____  

From: mondrian-bounces at pentaho.org [mailto:mondrian-bounces at pentaho.org] On
Behalf Of Fu Hongwei
Sent: Thursday, February 10, 2011 1:29 AM
To: mondrian
Subject: [Mondrian] Testing a Hive dialect 


Hi,
I'm new to the community. I don't know who to ask this for. 
I've written a Hive dialect for mondrian and been testing it.
The DialectTest is passed, but it's still failing other tests.
 
>From what I can see it's still a long way to make an integration
of Hive and Mondrian practical.
1. It's really slow. It takes 1 or 2 days to run through all the tests, 
a low end estimation. The latency is too big for most applications.
It might take some major architectural change on the Hive side to solve
this problem.
2. Hive ql is still at a rather immature stage, partly because it's not 
really intended to be a full featured relational database. There are some
 bugs too, like the join behavior is incorrect at the current trunk.
 
I know there is already a jira about it.
http://jira.pentaho.com/browse/MONDRIAN-789 
How can I submit the code? Thanks
2011-02-10 

  _____  

Fu Hongwei 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.pentaho.org/pipermail/mondrian/attachments/20110210/f60f382d/attachment.html 


More information about the Mondrian mailing list