Very slow web client on 8.5 server that was upgraded from 8.0.

Ask questions about your setup or get help installing ZCS server (ZD section below).
User avatar
tonster
Zimbra Employee
Zimbra Employee
Posts: 313
Joined: Fri Feb 21, 2014 10:14 am
Location: Ypsilanti, MI
ZCS/ZD Version: Release 8.7.0_GA_1659.RHEL6_64_2016

Very slow web client on 8.5 server that was upgraded from 8.0.

Postby tonster » Wed Oct 01, 2014 8:57 pm

From the case, I'm guessing that you must have had a typo in the change that you made to workaround to Bug 95630 since mailboxd wouldn't start after you made the change, and that's likely in large part why you're having issues. Until the patch is released, you can do the following:



Download http://files.zimbra.com/downloads/support/bug95630/zimbrastore.jar to a dir like /tmp

Make a backup copy of /opt/zimbra/lib/jars/zimbrastore.jar



Copy the new zimbrastore.jar to the following locations:



/opt/zimbra/jetty/webapps/service/WEB-INF/lib/zimbrastore.jar

/opt/zimbra/jetty/webapps/zimbra/WEB-INF/lib/zimbrastore.jar

/opt/zimbra/jetty/webapps/zimbraAdmin/WEB-INF/lib/zimbrastore.jar

/opt/zimbra/lib/jars/zimbrastore.jar



Restart mailboxd:



zmmailboxdctl restart



Let me know if that helps!


User avatar
pup_seba
Outstanding Member
Outstanding Member
Posts: 687
Joined: Sat Sep 13, 2014 2:43 am
Location: Tarragona - Spain
Contact:

Very slow web client on 8.5 server that was upgraded from 8.0.

Postby pup_seba » Thu Oct 02, 2014 6:40 am

Sorry for late response! I'm still not used to new forums :) (i don't receive notifications for new comments on threads I'm participating)



There was a know bug with some linux kernels and high cpu java, could this be afecting you?

http://stackoverflow.com/questions/11283271/jvm-always-beyond-100-cpu-usage-in-centos-6



The advice given by tonster looks really cool :) If it works, could you please confirm looking at your bash history that the problem was caused by a mistype?



Good luck!

Sebas
bjquinn
Advanced member
Advanced member
Posts: 179
Joined: Fri Sep 12, 2014 10:00 pm

Very slow web client on 8.5 server that was upgraded from 8.0.

Postby bjquinn » Thu Oct 02, 2014 2:14 pm

@Sebastian thanks, I tried the following --



service ntpd stop; date -s "`date`";service ntpd start;



Should I restart zimbra after doing that? I didn't notice any immediate change.
bjquinn
Advanced member
Advanced member
Posts: 179
Joined: Fri Sep 12, 2014 10:00 pm

Very slow web client on 8.5 server that was upgraded from 8.0.

Postby bjquinn » Thu Oct 02, 2014 2:26 pm

@tonster thanks for the suggestion. It's certainly possible I had a typo in the change I made for the workaround. However, the workaround I was given didn't involve zimbrastore.jar (at least not directly), I was suggested to do the instructions I've copied to the bottom of this post. Anyway, I may certainly have made a typo, as I reapplied the workaround last night after hours and it seemed to have no problems restarting the services after that. I don't know what I did differently, but I was able to restart the zimbra services five times in a row without any issues.



However -- although I haven't had the server run into completely crippled status yet since last night, I'm still seeing the super high java usage (constant 150%+ CPU in top). Should I also update zimbrastore.jar as you suggested or is that something different?



Anyway, here's the instructions I was given to work around the problem --



----



As the zimbra user, change directory into /opt/zimbra/jetty/etc.



Edit the service.web.xml.in and zimbra.web.xml.in files, and comment out the following section.



<!--



<filter>



<filter-name>ContextPathBasedThreadPoolBalancerFilter</filter-name>



<filter-class>com.zimbra.cs.servlet.ContextPathBasedThreadPoolBalancerFilter</filter-class>



<async-supported>true</async-supported>





<init-param>



<param-name>suspendMs</param-name>



<param-value>1000</param-value>



</init-param>





<init-param>



<param-name>Rules</param-name>



<param-value>%%list VAR:zimbraHttpContextPathBasedThreadPoolBalancingFilterRules , %%</param-value>



</init-param>



</filter>





<filter-mapping>



<filter-name>ContextPathBasedThreadPoolBalancerFilter</filter-name>



<url-pattern>/*</url-pattern>



</filter-mapping>



-->





Once the section is commented out, restart mailboxd to pick up the changes.





zmmailboxdctl restart



---
bjquinn
Advanced member
Advanced member
Posts: 179
Joined: Fri Sep 12, 2014 10:00 pm

Very slow web client on 8.5 server that was upgraded from 8.0.

Postby bjquinn » Thu Oct 02, 2014 3:53 pm

@Sebastian, also I looked at the CPU history charts in the admin tool, and I see steady 90%-95% idle from both before and after the June 30 leap second, all the way until September 26 when I ran the upgrade from 8.0.6 to 8.5. I've been at an average of 50% idle ever since, and the 50% idle is just because Java seems to peg at using nearly 100% of two of my four threads. So basically I'm maxed out all the time, and this issue directly coincided with the upgrade to 8.5.



Thanks for the heads up on this issue though. Surprised it hasn't bitten me yet on some other server.
bjquinn
Advanced member
Advanced member
Posts: 179
Joined: Fri Sep 12, 2014 10:00 pm

Very slow web client on 8.5 server that was upgraded from 8.0.

Postby bjquinn » Thu Oct 02, 2014 4:02 pm

And also, if I the zimbrastore.jar update is the "fix" and what I did was the "workaround", should I undo the workaround before I put in the fix?
User avatar
tonster
Zimbra Employee
Zimbra Employee
Posts: 313
Joined: Fri Feb 21, 2014 10:14 am
Location: Ypsilanti, MI
ZCS/ZD Version: Release 8.7.0_GA_1659.RHEL6_64_2016

Very slow web client on 8.5 server that was upgraded from 8.0.

Postby tonster » Thu Oct 02, 2014 8:59 pm

Yes, my suggestion earlier was actually the fix, so you should go ahead and remove your workaround. I took the fix from the forthcoming patch and just posted the new jar and gave you instructions to manually implement the change. Give that a shot and see if it helps out.
bjquinn
Advanced member
Advanced member
Posts: 179
Joined: Fri Sep 12, 2014 10:00 pm

Very slow web client on 8.5 server that was upgraded from 8.0.

Postby bjquinn » Mon Oct 13, 2014 5:29 pm

I'm still experiencing this issue. Anyone have any ideas?

Return to “Installation and Upgrade”

Who is online

Users browsing this forum: No registered users and 6 guests