[Mondrian] VFS issue
Matt Campbell
mkambol at gmail.com
Wed Jul 29 08:11:48 EDT 2009
I created MONDRIAN-585 for the bug, fixed with checkin 12976, MONDRIAN-586
is the reminder to revisit the workaround when the next version of
httpclient is available.
On Mon, Jul 20, 2009 at 12:05 PM, Julian Hyde <jhyde at pentaho.com> wrote:
> That sounds fine, Matt. Can you log a jira request to remind us to
> revisit this.
>
> Julian
>
> ------------------------------
> *From:* mondrian-bounces at pentaho.org [mailto:mondrian-bounces at pentaho.org]
> *On Behalf Of *Matt Campbell
> *Sent:* Monday, July 20, 2009 8:42 AM
> *To:* Mondrian developer mailing list
> *Subject:* Re: [Mondrian] VFS issue
>
> Thanks for sending the jar, Will. Same problem, though. I also tried
> grabbing the latest release of the commons httpclient. That also failed to
> help.
>
> If no one objects, how about I revert back to using the readURL method for
> http requests, leaving the existing VFS option for other file reads? When
> the commons httpclient 4.0 is released we could re-visit this.
>
>
>
> On Sat, Jul 18, 2009 at 12:51 AM, Will Gorman <wgorman at pentaho.com> wrote:
>
>> Hey Guys,
>>
>> We are still using VFS in Kettle and Mondrian, Kettle 3.2.0 ended up
>> building from source the latest VFS because they haven't released 2.0 of
>> VFS yet. I'm not sure if that would solve these issues or not.
>>
>> In Pentaho's BI Platform, we access our schema files using a custom VFS
>> provider so that it can access our solution repository, so we rely on
>> VFS.
>>
>> Here is a link to Kettle's custom built VFS 2.0 jar if you want to see
>> if it resolves the issues:
>>
>> http://source.pentaho.org/svnkettleroot/Kettle/trunk/libext/commons/commons-vfs-2.0-20090205.jar
>>
>> Will
>>
>> On Fri, 2009-07-17 at 15:08 -0400, Matt Campbell wrote:
>> > I did do a fair amount of searching when we first encountered this
>> > problem and couldn't find much helpful information at all. When I get
>> > a chance I'll see if there is a newer version of VFS.
>> >
>> > On Fri, Jul 17, 2009 at 2:25 PM, Julian Hyde <jhyde at pentaho.com>
>> > wrote:
>> > Has anyone done a google search for the issue you are
>> > experiencing? Is there a newer version of VFS that might fix
>> > the problem?
>> >
>> > Will, what was the other technology you used?
>> >
>> > I'm OK with switching technology as long as it doesn't break
>> > existing apps.
>> >
>> > Julian
>> >
>> >
>> > ______________________________________________________
>> > From: mondrian-bounces at pentaho.org
>> > [mailto:mondrian-bounces at pentaho.org] On Behalf Of
>> > Matt Campbell
>> > Sent: Friday, July 17, 2009 8:16 AM
>> > To: Mondrian developer mailing list
>> > Subject: [Mondrian] VFS issue
>> >
>> >
>> >
>> > Awhile back we discovered that Util.readVirtualFile()
>> > can throw exceptions when large numbers of requests
>> > for an HTTP resource happen. Awhile back I added a
>> > call to file.close() at the end of that method, which
>> > had seemed to make things a bit better in testing.
>> > I'm still seeing socketConnect exceptions when
>> > requesting more than a few hundred http requests. In
>> > practice this can happen when we have as few as 15
>> > concurrent users running reports.
>> >
>> > There appears to be no such problem with the pre-VFS
>> > method that Mondrian used for loading a URL. I
>> > created a Unit test which loads 100,000 pages via the
>> > old Util.readURL method. That runs fine with no
>> > exceptions. The VFS method fails with fewer than 1000
>> > requests.
>> >
>> > Would anyone object to reverting back to the old
>> > Util.readURL for http requests? Alternatively, I
>> > think Will Gorman said at one point that they
>> > abandoned VFS for other Pentaho projects in favor of
>> > some other library--would that be worth considering
>> > for Mondrian?
>> >
>> >
>> >
>> >
>> > _______________________________________________
>> > Mondrian mailing list
>> > Mondrian at pentaho.org
>> > http://lists.pentaho.org/mailman/listinfo/mondrian
>> >
>> >
>> > _______________________________________________
>> > Mondrian mailing list
>> > Mondrian at pentaho.org
>> > http://lists.pentaho.org/mailman/listinfo/mondrian
>>
>> _______________________________________________
>> Mondrian mailing list
>> Mondrian at pentaho.org
>> http://lists.pentaho.org/mailman/listinfo/mondrian
>>
>
>
> _______________________________________________
> Mondrian mailing list
> Mondrian at pentaho.org
> http://lists.pentaho.org/mailman/listinfo/mondrian
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.pentaho.org/pipermail/mondrian/attachments/20090729/56d4d3c5/attachment.html
More information about the Mondrian
mailing list