-
-
Notifications
You must be signed in to change notification settings - Fork 925
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
JRuby 9.0.5.0+ OOM errors under CentOS #3941
Comments
@etehtsea Thanks for the report! It's very strange to see such different behavior just moving to another Linux flavor. Thank you also for including the 9.0.5.0 output...it's helpful to know it it existed before JRuby 9.1. Can you try to reproduce with this flag passed to JRuby, please: That should produce a dump of your |
This may be related to jruby/jruby-openssl#94. Memory consumption from that issue is directly related to the X509 certificates installed on a machine. A heap dump will tell you for sure as classes related to X509 certificates will use up lots of memory if this is the same underlying cause. |
@etehtsea Thanks! I'll have a look at it today. |
Ok, there appears to be a few things taking up a lot of memory. I used Eclipse Memory Analyzer to do a leak search and it found the following items:
So of these, only (2) seems to be a regression. The others could be improved, but it may require working with RubyGems and Bundler folks. Since we already have jruby/jruby-openssl#94 I'm going to close this as a duplicate. FWIW, here's the top 25-or-so dominators in your heap dump:
|
@etehtsea We are working on a fix that will go into a jruby-openssl release, but as a short term workaround can you try passing |
@etehtsea Sorry, I guess that workaround won't work until we get next jruby-openssl release out, in which case we'll just fix it. |
This issue also reproduced on production app after ~2 days of running under new jruby version. At some point we started to get OOM errors in our error-catcher and rpm on this node decreased relatively to other nodes which ran under 9.0.4.0. After switching to ubuntu based container this issue disappeared.
Results matrix:
JRuby 9.0.4.0 (Centos): 👍
JRuby 9.0.5.0+ (Centos): 👎
JRuby 9.0.5.0+ (Ubuntu): 👍
Images used below available on docker hub:
P.S. Notice that
bundler
1.12.0+
has another perf issue (rubygems/bundler#4478) so I pinnedbundler
version to1.11.2
.Gemfile used:
JRuby 9.0.4.0 (CentOS)
JRuby 9.0.5.0 (CentOS)
JRuby 9.1.2.0 (CentOS)
JRuby 9.0.5.0 (Ubuntu)
JRuby 9.1.2.0 (Ubuntu)
The text was updated successfully, but these errors were encountered: