[Mondrian] VFS issue

[Julian Hyde]

That sounds fine, Matt. Can you log a jira request to remind us to revisit
this.
 
Julian


  _____  

From: mondrian-bounces at pentaho.org [mailto:mondrian-bounces at pentaho.org] On
Behalf Of Matt Campbell
Sent: Monday, July 20, 2009 8:42 AM
To: Mondrian developer mailing list
Subject: Re: [Mondrian] VFS issue


Thanks for sending the jar, Will.  Same problem, though.  I also tried
grabbing the latest release of the commons httpclient.  That also failed to
help.

If no one objects, how about I revert back to using the readURL method for
http requests, leaving the existing VFS option for other file reads?  When
the commons httpclient 4.0 is released we could re-visit this.




On Sat, Jul 18, 2009 at 12:51 AM, Will Gorman <wgorman at pentaho.com> wrote:


Hey Guys,

We are still using VFS in Kettle and Mondrian, Kettle 3.2.0 ended up
building from source the latest VFS because they haven't released 2.0 of
VFS yet.  I'm not sure if that would solve these issues or not.

In Pentaho's BI Platform, we access our schema files using a custom VFS
provider so that it can access our solution repository, so we rely on
VFS.

Here is a link to Kettle's custom built VFS 2.0 jar if you want to see
if it resolves the issues:
http://source.pentaho.org/svnkettleroot/Kettle/trunk/libext/commons/commons-
vfs-2.0-20090205.jar

Will


On Fri, 2009-07-17 at 15:08 -0400, Matt Campbell wrote:
> I did do a fair amount of searching when we first encountered this
> problem and couldn't find much helpful information at all.  When I get
> a chance I'll see if there is a newer version of VFS.
>
> On Fri, Jul 17, 2009 at 2:25 PM, Julian Hyde <jhyde at pentaho.com>
> wrote:
>         Has anyone done a google search for the issue you are
>         experiencing? Is there a newer version of VFS that might fix
>         the problem?
>
>         Will, what was the other technology you used?
>
>         I'm OK with switching technology as long as it doesn't break
>         existing apps.
>
>         Julian
>
>
>                 ______________________________________________________
>                 From: mondrian-bounces at pentaho.org
>                 [mailto:mondrian-bounces at pentaho.org] On Behalf Of
>                 Matt Campbell
>                 Sent: Friday, July 17, 2009 8:16 AM
>                 To: Mondrian developer mailing list
>                 Subject: [Mondrian] VFS issue
>
>
>
>                 Awhile back we discovered that Util.readVirtualFile()
>                 can throw exceptions when large numbers of requests
>                 for an HTTP resource happen.  Awhile back I added a
>                 call to file.close() at the end of that method, which
>                 had seemed to make things a bit better in testing.
>                 I'm still seeing socketConnect exceptions when
>                 requesting more than a few hundred http requests.  In
>                 practice this can happen when we have as few as 15
>                 concurrent users running reports.
>
>                 There appears to be no such problem with the pre-VFS
>                 method that Mondrian used for loading a URL.  I
>                 created a Unit test which loads 100,000 pages via the
>                 old Util.readURL method.  That runs fine with no
>                 exceptions.  The VFS method fails with fewer than 1000
>                 requests.
>
>                 Would anyone object to reverting back to the old
>                 Util.readURL for http requests?  Alternatively, I
>                 think Will Gorman said at one point that they
>                 abandoned VFS for other Pentaho projects in favor of
>                 some other library--would that be worth considering
>                 for Mondrian?
>
>
>
>
>         _______________________________________________
>         Mondrian mailing list
>         Mondrian at pentaho.org
>         http://lists.pentaho.org/mailman/listinfo/mondrian
>
>
> _______________________________________________
> Mondrian mailing list
> Mondrian at pentaho.org
> http://lists.pentaho.org/mailman/listinfo/mondrian

_______________________________________________
Mondrian mailing list
Mondrian at pentaho.org
http://lists.pentaho.org/mailman/listinfo/mondrian



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.pentaho.org/pipermail/mondrian/attachments/20090720/c2a6691a/attachment.html