Page 1 of 3 123 LastLast
Results 1 to 10 of 21

Thread: Mail delivered for a while then simply queued

  1. #1
    Join Date
    Sep 2005
    Posts
    51
    Rep Power
    10

    Default Mail delivered for a while then simply queued

    Hi,

    I'm running tests on a multi-box setup (1xLDAP, 1xSMTP, 1xMailstore) now to spread the load a little. I'm sending about an avg of 5 messages every 10 seconds, from 5k to 14mb across about 10 users.

    All is fine for a while and mail is delivered as expected. But then it simply seems to be queued and held in the active postfix queue (currently sitting with ~1100 messages in it and growing all the time).

    The load on the SMTP box is sitting at :
    Code:
    $> uptime
     12:00:58 up  1:39,  3 users,  load average: 0.26, 0.42, 0.46
    
    $> free
                 total       used       free     shared    buffers     cached
    Mem:        514484     499396      15088          0      23976     267316
    -/+ buffers/cache:     208104     306380
    Swap:      1048568        232    1048336
    The load on the other two is very low. /var/log/zimbra.log on the smtp box is simply showing this for each new message :
    Code:
    Feb 17 12:02:45 p317-02 postfix/qmgr[10768]: 920C83788D6: from=<root@xxxxx>, size=5087, nrcpt=1 (queue active)
    Feb 17 12:02:45 p317-02 sendmail[4090]: k1HC2jJm004090: to=user@xxxxx, ctladdr=root (0/0), delay=00:00:00, xdelay=00:00:00, mailer=relay, pri=34619, relay=[127.0.0.1] [127.0.0.1], dsn=2.0.0, stat=Sent (Ok: queued as 920C83788D6)
    Feb 17 12:02:45 p317-02 postfix/smtpd[2843]: disconnect from localhost.localdomain[127.0.0.1]
    Running /opt/zimbra/postfix/sbin/postqueue -f doesn't seem to do anything. There have been no mail deliveries to any of the users for an hour at least.

    All the boxes are regular CentOS 4.2, no VM's etc.

    Edit: about 20 or so messages were just delivered to each user, but 1400 are now in the active queue....
    Last edited by billybofh; 02-17-2006 at 04:15 AM.

  2. #2
    Join Date
    Aug 2005
    Location
    San Mateo, CA
    Posts
    4,789
    Rep Power
    19

    Default

    What does /opt/zimbra/log/zimbra.log say on the mail store host. Can you take a thread dump of tomcat so see if LMTP is processing mail?

    Can you telnet to 7025 from the MTA (postfix) box to the mailstore?
    Looking for new beta users -> Co-Founder of Acompli. Previously worked at Zimbra (and Yahoo! & VMware) since 2005.

  3. #3
    Join Date
    Sep 2005
    Posts
    51
    Rep Power
    10

    Default

    The zimbra.log on the mailstore simply has :
    Code:
    Feb 17 14:12:03 xxxx zimbramon[10959]: 10959:info: 2006-02-17 14:12:01, ST
    ATUS: xxxxx: logger: Running
    Feb 17 14:12:03 xxxxxx zimbramon[10959]: 10959:info: 2006-02-17 14:12:01, ST
    ATUS: xxxxxx: mailbox: Running
    Feb 17 14:13:03 xxxxx zimbramon[11455]: 11455:info: 2006-02-17 14:13:01, ST
    ATUS: xxxxxx: logger: Running
    Feb 17 14:13:03 xxxxx zimbramon[11455]: 11455:info: 2006-02-17 14:13:01, ST
    ATUS: xxxxx: mailbox: Running
    Feb 17 14:14:03 xxxxx zimbramon[11801]: 11801:info: 2006-02-17 14:14:01, ST
    ATUS: xxxxxx: logger: Running
    If I had any idea how to do a thread-dump of tomcat I would

    I can telnet ok from the smtp -> mailstore on port 7025. The mail does slowly trickly through. ~20 messages in an hour. I stopped the test once > 3000 messages were queued on the smtp server with no deliveries for about an hour....

  4. #4
    Join Date
    Aug 2005
    Location
    San Mateo, CA
    Posts
    4,789
    Rep Power
    19

    Default

    kill -QUIT <tomcat pid>

    This will dump thread stacks to /opt/zimbra/tomcat/logs/catalina.out
    Looking for new beta users -> Co-Founder of Acompli. Previously worked at Zimbra (and Yahoo! & VMware) since 2005.

  5. #5
    Join Date
    Sep 2005
    Posts
    51
    Rep Power
    10

    Default

    Dump attached.
    Attached Files Attached Files

  6. #6
    Join Date
    Aug 2005
    Location
    San Mateo, CA
    Posts
    4,789
    Rep Power
    19

    Default

    These threads all look idle. Are you sure it was locked up and not processing mail at this time? Are you running the GA version that has the fix for the number of active amavis threads.
    Looking for new beta users -> Co-Founder of Acompli. Previously worked at Zimbra (and Yahoo! & VMware) since 2005.

  7. #7
    Join Date
    Sep 2005
    Posts
    51
    Rep Power
    10

    Default

    Hi,

    I've never said it was locked up. It just wasn't delivering anything. The MTA was running, the mailbox was running, LDAP was running. The MTA was just queing rather than delivering. Even now > 24hrs later there are still about 180 messages queued.

    I notice that now if I restart zimbra on the MTA box I get the following :

    Code:
    Starting mta...FAILED
    getService: sasl
    getService: webxml
    getService: mailbox
    getService: perdition
    DO: /opt/zimbra/postfix/sbin/postconf -e content_filter='smtp-amavis:[127.0.0.1]:10024'
    DO: /opt/zimbra/postfix/sbin/postconf -e myhostname='xxxxxx'
    DO: /opt/zimbra/postfix/sbin/postconf -e recipient_delimiter=''
    DO: /opt/zimbra/postfix/sbin/postconf -e smtpd_sasl_auth_enable='yes'
    DO: /opt/zimbra/postfix/sbin/postconf -e smtpd_tls_auth_only='yes'
    DO: /opt/zimbra/postfix/sbin/postconf -e disable_dns_lookups='no'
    DO: /opt/zimbra/postfix/sbin/postconf -e message_size_limit='30720000'
    DO: /opt/zimbra/postfix/sbin/postconf -e relayhost='xxxxxxxxxxx:25'
    DO: /opt/zimbra/postfix/sbin/postconf -e smtpd_recipient_restrictions='reject_non_fqdn_recipient, permit_sasl_authenticated, permit_mynetworks, reject_invalid_hostname, reject_non_fqdn_sender, reject_unauth_destination, permit'
    saslauthd[17579] :set_auth_mech   : failed to initialize mechanism zimbra
    zimbra.log :
    Code:
    Feb 18 18:29:03 xxxxxx zimbramon[17956]: 17956:info: 2006-02-18 18:29:01, STATUS: xxxxxx: mta: Stopped

  8. #8
    Join Date
    Aug 2005
    Location
    San Mateo, CA
    Posts
    4,789
    Rep Power
    19

    Default

    Seems there is a problem with sasl not sure why that would effect delivery though.
    Looking for new beta users -> Co-Founder of Acompli. Previously worked at Zimbra (and Yahoo! & VMware) since 2005.

  9. #9
    Join Date
    Sep 2005
    Posts
    51
    Rep Power
    10

    Default

    Does anyone have any ideas? This is a bit of a show-stopper as this was only simulating my off-peak load...

  10. #10
    Join Date
    Sep 2005
    Posts
    51
    Rep Power
    10

    Default

    Running without sasl seems to make the deliveries speedier. I'm not seeing the queuing behaviour any more at least. How-ever I do seem to be missing the ssl cert which is what I think is causing the problem.

    I've tried the various zmcreatecert solutions from other threads - but none seem to be helping (or indeed even creating the cert). For instance running as the zimbra user gives me :

    Code:
    [zimbra@xxxxxx ~]$ zmcreatecert
    ** Importing CA
    
    keytool error: java.lang.Exception: Certificate not imported, alias <my_ca> already exists
    ** Creating keystore
    
    ** Creating server cert request
    
    Generating a 1024 bit RSA private key
    ...................................................................................................++++++
    .......................................++++++
    writing new private key to '/opt/zimbra/ssl/ssl/server/server.key'
    -----
    ** Signing cert request
    
    Using configuration from /opt/zimbra/ssl/ssl/zmssl.cnf
    Check that the request matches the signature
    Signature ok
    Certificate Details:
            Serial Number: 16 (0x10)
            Validity
                Not Before: Feb 20 15:02:45 2006 GMT
                Not After : Feb 20 15:02:45 2007 GMT
            Subject:
                countryName               = US
                stateOrProvinceName       = N/A
                organizationName          = Zimbra Collaboration Suite
                commonName                = xxxxxx
            X509v3 extensions:
                X509v3 Basic Constraints:
                CA:FALSE
                Netscape Comment:
                OpenSSL Generated Certificate
                X509v3 Subject Key Identifier:
                8E:78:D0:75:BD:FD:8F:DF:52:45:28:0E:E4:68:F9:DE:0B:1A:88:AF
                X509v3 Authority Key Identifier:
                DirName:/C=US/ST=N/A/L=N/A/O=Zimbra Collaboration Suite/CN=xxxxxx
                serial:00
    
    Certificate is to be certified until Feb 20 15:02:45 2007 GMT (365 days)
    
    Write out database with 1 new entries
    Data Base Updated
    Signature ok
    subject=/C=US/ST=NA/L=NA/O=Zimbra/OU=Zimbra/CN=xxxxxx
    Getting CA Private Key
    
    [zimbra@xxxxxx ~]$ find /opt/zimbra/ssl/
    /opt/zimbra/ssl/
    /opt/zimbra/ssl/ssl
    /opt/zimbra/ssl/ssl/ca
    /opt/zimbra/ssl/ssl/ca/ca.key
    /opt/zimbra/ssl/ssl/ca/ca.srl.old
    /opt/zimbra/ssl/ssl/ca/ca.srl
    /opt/zimbra/ssl/ssl/ca/ca.pem
    /opt/zimbra/ssl/ssl/server
    /opt/zimbra/ssl/ssl/server/tomcat.crt
    /opt/zimbra/ssl/ssl/server/server.crt
    /opt/zimbra/ssl/ssl/server/server.csr
    /opt/zimbra/ssl/ssl/server/tomcat.csr
    /opt/zimbra/ssl/ssl/server/server.key
    /opt/zimbra/ssl/ssl/cert
    /opt/zimbra/ssl/ssl/newCA
    /opt/zimbra/ssl/ssl/newCA/index.txt.old
    /opt/zimbra/ssl/ssl/newCA/index.txt
    /opt/zimbra/ssl/ssl/newCA/newcerts
    /opt/zimbra/ssl/ssl/newCA/newcerts/10.pem
    /opt/zimbra/ssl/ssl/zmssl.cnf
    So I see this in the logs :
    Code:
    Feb 20 15:07:30 xxxxxx postfix/smtpd[23279]: initializing the server-side TLS engine
    Feb 20 15:07:30 xxxxxx postfix/smtpd[23279]: warning: cannot get private key from file /opt/zimbra/conf/smtpd.key
    Feb 20 15:07:30 xxxxxx postfix/smtpd[23279]: warning: TLS library problem: 23279:error:02001002:system library:fopen:No such file or directory:bss_file.c:259:fopen('/opt/zimbra/conf/smtpd.key','r'):
    Feb 20 15:07:30 xxxxxx postfix/smtpd[23279]: warning: TLS library problem: 23279:error:20074002:BIO routines:FILE_CTRL:system lib:bss_file.c:261:
    Feb 20 15:07:30 xxxxxx postfix/smtpd[23279]: warning: TLS library problem: 23279:error:140B0002:SSL routines:SSL_CTX_use_PrivateKey_file:system lib:ssl_rsa.c:691:
    Feb 20 15:07:30 xxxxxx postfix/smtpd[23279]: cannot load RSA certificate and key data
    Feb 20 15:07:30 xxxxxx postfix/smtpd[23279]: connect from localhost.localdomain[127.0.0.1]
    Feb 20 15:07:30 xxxxxx postfix/smtpd[23279]: 6C735378452: client=localhost.localdomain[127.0.0.1]
    I've tried going through all of the steps in : http://www.zimbra.com/forums/showthread.php?t=741 and various other threads with no luck. This is a 3-machine setup (1xLDAP, 1xMTA, 1xMailstore) running the current network release on evaluation. CentOS 4.2, no VM's etc.

Similar Threads

  1. Problems with port 25
    By yogiman in forum Installation
    Replies: 57
    Last Post: 06-13-2011, 01:55 PM
  2. Replies: 7
    Last Post: 02-03-2011, 06:01 AM
  3. fresh install down may be due to tomcat
    By gon in forum Installation
    Replies: 10
    Last Post: 07-25-2007, 08:09 AM
  4. DynDNS and Zimbra
    By afterwego in forum Installation
    Replies: 30
    Last Post: 04-01-2007, 03:34 PM
  5. receiveing mail
    By maybethistime in forum Administrators
    Replies: 15
    Last Post: 12-09-2005, 03:55 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •