[Mondrian] VFS issue

Matt Campbell mkambol at gmail.com
Wed Jul 29 08:11:48 EDT 2009


I created MONDRIAN-585 for the bug, fixed with checkin 12976, MONDRIAN-586
is the reminder to revisit the workaround when the next version of
httpclient is available.

On Mon, Jul 20, 2009 at 12:05 PM, Julian Hyde <jhyde at pentaho.com> wrote:

>  That sounds fine, Matt. Can you log a jira request to remind us to
> revisit this.
>
> Julian
>
>  ------------------------------
> *From:* mondrian-bounces at pentaho.org [mailto:mondrian-bounces at pentaho.org]
> *On Behalf Of *Matt Campbell
> *Sent:* Monday, July 20, 2009 8:42 AM
> *To:* Mondrian developer mailing list
> *Subject:* Re: [Mondrian] VFS issue
>
> Thanks for sending the jar, Will.  Same problem, though.  I also tried
> grabbing the latest release of the commons httpclient.  That also failed to
> help.
>
> If no one objects, how about I revert back to using the readURL method for
> http requests, leaving the existing VFS option for other file reads?  When
> the commons httpclient 4.0 is released we could re-visit this.
>
>
>
> On Sat, Jul 18, 2009 at 12:51 AM, Will Gorman <wgorman at pentaho.com> wrote:
>
>> Hey Guys,
>>
>> We are still using VFS in Kettle and Mondrian, Kettle 3.2.0 ended up
>> building from source the latest VFS because they haven't released 2.0 of
>> VFS yet.  I'm not sure if that would solve these issues or not.
>>
>> In Pentaho's BI Platform, we access our schema files using a custom VFS
>> provider so that it can access our solution repository, so we rely on
>> VFS.
>>
>> Here is a link to Kettle's custom built VFS 2.0 jar if you want to see
>> if it resolves the issues:
>>
>> http://source.pentaho.org/svnkettleroot/Kettle/trunk/libext/commons/commons-vfs-2.0-20090205.jar
>>
>> Will
>>
>> On Fri, 2009-07-17 at 15:08 -0400, Matt Campbell wrote:
>> > I did do a fair amount of searching when we first encountered this
>> > problem and couldn't find much helpful information at all.  When I get
>> > a chance I'll see if there is a newer version of VFS.
>> >
>> > On Fri, Jul 17, 2009 at 2:25 PM, Julian Hyde <jhyde at pentaho.com>
>> > wrote:
>> >         Has anyone done a google search for the issue you are
>> >         experiencing? Is there a newer version of VFS that might fix
>> >         the problem?
>> >
>> >         Will, what was the other technology you used?
>> >
>> >         I'm OK with switching technology as long as it doesn't break
>> >         existing apps.
>> >
>> >         Julian
>> >
>> >
>> >                 ______________________________________________________
>> >                 From: mondrian-bounces at pentaho.org
>> >                 [mailto:mondrian-bounces at pentaho.org] On Behalf Of
>> >                 Matt Campbell
>> >                 Sent: Friday, July 17, 2009 8:16 AM
>> >                 To: Mondrian developer mailing list
>> >                 Subject: [Mondrian] VFS issue
>> >
>> >
>> >
>> >                 Awhile back we discovered that Util.readVirtualFile()
>> >                 can throw exceptions when large numbers of requests
>> >                 for an HTTP resource happen.  Awhile back I added a
>> >                 call to file.close() at the end of that method, which
>> >                 had seemed to make things a bit better in testing.
>> >                 I'm still seeing socketConnect exceptions when
>> >                 requesting more than a few hundred http requests.  In
>> >                 practice this can happen when we have as few as 15
>> >                 concurrent users running reports.
>> >
>> >                 There appears to be no such problem with the pre-VFS
>> >                 method that Mondrian used for loading a URL.  I
>> >                 created a Unit test which loads 100,000 pages via the
>> >                 old Util.readURL method.  That runs fine with no
>> >                 exceptions.  The VFS method fails with fewer than 1000
>> >                 requests.
>> >
>> >                 Would anyone object to reverting back to the old
>> >                 Util.readURL for http requests?  Alternatively, I
>> >                 think Will Gorman said at one point that they
>> >                 abandoned VFS for other Pentaho projects in favor of
>> >                 some other library--would that be worth considering
>> >                 for Mondrian?
>> >
>> >
>> >
>> >
>> >         _______________________________________________
>> >         Mondrian mailing list
>> >         Mondrian at pentaho.org
>> >         http://lists.pentaho.org/mailman/listinfo/mondrian
>> >
>> >
>> > _______________________________________________
>> > Mondrian mailing list
>> > Mondrian at pentaho.org
>> > http://lists.pentaho.org/mailman/listinfo/mondrian
>>
>> _______________________________________________
>> Mondrian mailing list
>> Mondrian at pentaho.org
>> http://lists.pentaho.org/mailman/listinfo/mondrian
>>
>
>
> _______________________________________________
> Mondrian mailing list
> Mondrian at pentaho.org
> http://lists.pentaho.org/mailman/listinfo/mondrian
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.pentaho.org/pipermail/mondrian/attachments/20090729/56d4d3c5/attachment.html 


More information about the Mondrian mailing list