Zimbra Admin API timed out

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
tuandungtb89
Posts: 15
Joined: Mon Jul 11, 2016 11:23 am

Zimbra Admin API timed out

Postby tuandungtb89 » Mon Jun 17, 2019 6:50 am

Hi,
Our system running on multiple servers, and when about 2000 user online concurrent, then users in my system could not send email.
I get these logs on zimbra.log
Jun 17 13:40:48 mta1 saslauthd[27164]: authentication against url 'https://mymailboxdomain.com:7073/service/admin/soap/' caused error 'curl_easy_perform: error(28): Operation timed out after 45005 milliseconds with 0 bytes received'
Jun 17 13:40:48 mta1 saslauthd[27164]: auth_zimbra: user@domain.com auth failed: curl_easy_perform: error(28): Operation timed out after 45005 milliseconds with 0 bytes received
Jun 17 13:40:48 mta1 saslauthd[27165]: url 'https://mail.vss.gov.vn:7073/service/admin/soap/' will not be used for (at least) 600 seconds
Jun 17 13:40:48 mta1 saslauthd[27165]: Authentication cycle re-elected url https://mail.vss.gov.vn:7073/service/admin/soap/, giving up ...


And this link usually timed out: https://mymailboxdomain.com:7071/service/admin/soap/
(Although I still telnet to mymailboxdomain.com 7071) and this issues gone if I restart zmmailboxdctl, but only in shortly time, it came again.
My mailbox server have 1T RAM, CPU: Intel(R) Xeon(R) CPU E7-8860 v4 @ 2.20GHz 144 core CPU and very much empty
Anyone can help me, I think the problem is that there are too many users at the same time


tuandungtb89
Posts: 15
Joined: Mon Jul 11, 2016 11:23 am

Re: Zimbra Admin API timed out

Postby tuandungtb89 » Tue Jun 18, 2019 2:26 am

Anyone can help me?
User avatar
DualBoot
Elite member
Elite member
Posts: 1258
Joined: Mon Apr 18, 2016 8:18 pm
Location: France - Earth
ZCS/ZD Version: ZCS FLOSS - 8.8.15 Mutli servers
Contact:

Re: Zimbra Admin API timed out

Postby DualBoot » Tue Jun 18, 2019 11:01 am

Hello,

have you check the log in the mailbox part ? Maybe you got into Zimbra anti DDoS.
Or you have passed the maximum number of thread pool.
Regards,
tuandungtb89
Posts: 15
Joined: Mon Jul 11, 2016 11:23 am

Re: Zimbra Admin API timed out

Postby tuandungtb89 » Tue Jun 18, 2019 11:25 am

Hi DualBoot!
I have searched all logs files on the server but only found the other log in zimbra.log
At the time of the error, mailboxd.log has no error log.
But in the trace log, I see lots of REQUEST POST to https://mailboxserver:7071/service/admin/soap but do not receive RESPONSE
It may be because the user is too high making the soap admin service overloaded (when something goes wrong, there are about 1500 online users, (I had total 20K users))
What is the "maximum number of thread pool" parameter that you say? I'm currently running the following parameters:
zimbraHttpNumThreads 2000
zimbraPop3NumThreads 3000
zimbraPop3MaxConnections 80000
zimbraImapMaxConnections 80000
zimbraLmtpNumThreads 200
zimbraHttpDosFilterMaxRequestsPerSec 200 (on MTA server)
zimbraHttpDosFilterMaxRequestsPerSec 500 (on Mailbox server)
Any other parameters that you want to me check?
Thanks!
User avatar
DualBoot
Elite member
Elite member
Posts: 1258
Joined: Mon Apr 18, 2016 8:18 pm
Location: France - Earth
ZCS/ZD Version: ZCS FLOSS - 8.8.15 Mutli servers
Contact:

Re: Zimbra Admin API timed out

Postby DualBoot » Tue Jun 18, 2019 11:31 am

you also have these 2 settings in the localconfig :
zimbra_session_limit_soap
zimbra_session_timeout_soap

Maybe it could be relevant to record some performances key points.
tuandungtb89
Posts: 15
Joined: Mon Jul 11, 2016 11:23 am

Re: Zimbra Admin API timed out

Postby tuandungtb89 » Tue Jun 18, 2019 2:45 pm

DualBoot wrote:you also have these 2 settings in the localconfig :
zimbra_session_limit_soap
zimbra_session_timeout_soap

Maybe it could be relevant to record some performances key points.


Hi DualBoot,
$ zmlocalconfig -s zimbra_session_limit_soap
zimbra_session_limit_soap = 5
$ zmlocalconfig -s zimbra_session_timeout_soap
zimbra_session_timeout_soap = 600

Maybe theses value are too small, right?
And I have to increase theses values on all MTA and Mailbox servers?
User avatar
DualBoot
Elite member
Elite member
Posts: 1258
Joined: Mon Apr 18, 2016 8:18 pm
Location: France - Earth
ZCS/ZD Version: ZCS FLOSS - 8.8.15 Mutli servers
Contact:

Re: Zimbra Admin API timed out

Postby DualBoot » Tue Jun 18, 2019 2:53 pm

On the target : the maibox server.
tuandungtb89
Posts: 15
Joined: Mon Jul 11, 2016 11:23 am

Re: Zimbra Admin API timed out

Postby tuandungtb89 » Tue Jun 18, 2019 2:55 pm

DualBoot wrote:On the target : the maibox server.

Thanks DualBoot, I'm going to change theses values and let you know the results.
tuandungtb89
Posts: 15
Joined: Mon Jul 11, 2016 11:23 am

Re: Zimbra Admin API timed out

Postby tuandungtb89 » Wed Jun 19, 2019 4:15 am

Hi DualBoot,
I changed zimbra_session_limit_soap=1000
$ zmlocalconfig -s zimbra_session_limit_soap
zimbra_session_limit_soap = 1000


then:
$zmconfigdctl restart
$zmmailboxd restart

But the problem continues.

Do you have any other ideas?

Return to “Administrators”

Who is online

Users browsing this forum: No registered users and 15 guests