Results 1 to 7 of 7

Thread: Problems with mail search since upgrade to 6.0.1

Hybrid View

  1. #1
    Join Date
    Apr 2009
    Location
    Beziers, France
    Posts
    11
    Rep Power
    6

    Default Problems with mail search since upgrade to 6.0.1

    Hi,

    I'm experiencing the same problems as stated here, http://www.zimbra.com/forums/adminis...r-reindex.html - Search function ignores the messages received or sent since migration, and Reindex has no visible result.

    I used to be on Release 5.0.13_GA_2791.UBUNTU8_64 UBUNTU8_64 FOSS edition, then migrated to 6.01, and today to the latest 6.0.2_GA_1912.UBUNTU8_64 UBUNTU8_64 FOSS.

    Unfortunately, "zmconvertctl start" does nothing - as bin/zmconvertctl is missing on my server.

    Can you please help me ?

    Thanks, Fred

  2. #2
    Join Date
    Feb 2007
    Location
    Portland, OR
    Posts
    1,147
    Rep Power
    10

    Default

    What errors are you seeing in the log? You really shouldn't be seeing the EXACT same error as the linked thread on a FOSS server because as you said, convertd isn't even available.

  3. #3
    Join Date
    Apr 2009
    Location
    Beziers, France
    Posts
    11
    Rep Power
    6

    Default

    Thanks for your answer.

    Of course you're right, the effect is the same, not the causes.

    Funny, it's the same thing you noted on http://www.zimbra.com/forums/adminis...upt-index.html :

    I have many
    Code:
    2009-11-10 08:23:26,825 WARN  [LmtpServer-284] [name=some.one@nowhere.com;mid=8;ip=192.168.1.7;] indexadd - Caught exception while indexing message id 32872 - indexing blocked.  Possibly corrupt index?
    java.lang.NullPointerException: value cannot be null
            at org.apache.lucene.document.Field.<init>(Field.java:275)
            at org.apache.lucene.document.Field.<init>(Field.java:251)
            at com.zimbra.cs.index.LuceneIndex.addDocument(LuceneIndex.java:199)
            at com.zimbra.cs.index.MailboxIndex.indexMailItem(MailboxIndex.java:501)
            at com.zimbra.cs.mailbox.IndexHelper.indexingPartOfEndTransaction(IndexHelper.java:994)
            at com.zimbra.cs.mailbox.Mailbox.endTransaction(Mailbox.java:6592)
            at com.zimbra.cs.mailbox.IndexHelper.indexItemList(IndexHelper.java:889)
            at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItemsInternal(IndexHelper.java:359)
            at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItems(IndexHelper.java:277)
            at com.zimbra.cs.mailbox.IndexHelper.maybeIndexDeferredItems(IndexHelper.java:233)
            at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:4169)
            at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:4162)
            at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:4122)
            at com.zimbra.cs.filter.IncomingMessageHandler.addMessage(IncomingMessageHandler.java:116)
            at com.zimbra.cs.filter.IncomingMessageHandler.implicitKeep(IncomingMessageHandler.java:109)
            at com.zimbra.cs.filter.ZimbraMailAdapter.doDefaultFiling(ZimbraMailAdapter.java:284)
            at com.zimbra.cs.filter.ZimbraMailAdapter.executeActions(ZimbraMailAdapter.java:188)
            at org.apache.jsieve.SieveFactory.evaluate(SieveFactory.java:164)
            at com.zimbra.cs.filter.RuleManager.applyRulesToIncomingMessage(RuleManager.java:348)
            at com.zimbra.cs.filter.RuleManager.applyRulesToIncomingMessage(RuleManager.java:311)
            at com.zimbra.cs.lmtpserver.ZimbraLmtpBackend.deliverMessageToLocalMailboxes(ZimbraLmtpBackend.java:425)
            at com.zimbra.cs.lmtpserver.ZimbraLmtpBackend.deliverMessageToLocalMailboxes(ZimbraLmtpBackend.java:257)
            at com.zimbra.cs.lmtpserver.ZimbraLmtpBackend.deliver(ZimbraLmtpBackend.java:162)
            at com.zimbra.cs.lmtpserver.LmtpHandler.processMessageData(LmtpHandler.java:365)
            at com.zimbra.cs.lmtpserver.TcpLmtpHandler.continueDATA(TcpLmtpHandler.java:72)
            at com.zimbra.cs.lmtpserver.LmtpHandler.doDATA(LmtpHandler.java:350)
            at com.zimbra.cs.lmtpserver.LmtpHandler.processCommand(LmtpHandler.java:170)
            at com.zimbra.cs.lmtpserver.TcpLmtpHandler.processCommand(TcpLmtpHandler.java:66)
            at com.zimbra.cs.tcpserver.ProtocolHandler.processConnection(ProtocolHandler.java:175)
            at com.zimbra.cs.tcpserver.ProtocolHandler.run(ProtocolHandler.java:132)
            at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
            at java.lang.Thread.run(Thread.java:619)
    then some like those (after the update to 6.0.2) :
    Code:
    2009-11-10 22:48:04,642 INFO  [btpool0-50://somewhere.com/service/soap/SendMsgRequest] [name=some.one@nowhere.com;mid=8;ip=192.168.1.8;ua=ZimbraWebClient - FF3.0 (Linux)/6.0.2_GA_1912.
    UBUNTU8_64;] mailbox - IndexDeferredItems(79190-33059, 79190): Deferred count out of sync - found=4 in progress=8 (deferred count=16)
    2009-11-10 22:48:04,876 WARN  [btpool0-50://nowhere.com/service/soap/SendMsgRequest] [name=some.one@nowhere.com;mid=8;ip=192.168.1.8;ua=ZimbraWebClient - FF3.0 (Linux)/6.0.2_GA_1912.
    UBUNTU8_64;] indexadd - Caught exception while indexing message id 33063 - indexing blocked.  Possibly corrupt index?
    java.lang.NullPointerException: value cannot be null
            at org.apache.lucene.document.Field.<init>(Field.java:275)
            at org.apache.lucene.document.Field.<init>(Field.java:251)
            at com.zimbra.cs.index.LuceneIndex.addDocument(LuceneIndex.java:200)
            at com.zimbra.cs.index.MailboxIndex.indexMailItem(MailboxIndex.java:513)
            at com.zimbra.cs.mailbox.IndexHelper.indexingPartOfEndTransaction(IndexHelper.java:995)
            at com.zimbra.cs.mailbox.Mailbox.endTransaction(Mailbox.java:6669)
            at com.zimbra.cs.mailbox.IndexHelper.indexItemList(IndexHelper.java:890)
            at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItemsInternal(IndexHelper.java:360)
            at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItems(IndexHelper.java:278)
            at com.zimbra.cs.mailbox.IndexHelper.search(IndexHelper.java:122)
            at com.zimbra.cs.mailbox.Mailbox.search(Mailbox.java:3427)
            at com.zimbra.cs.mailbox.Mailbox.search(Mailbox.java:3394)
            at com.zimbra.cs.mailbox.ContactAutoComplete.queryFolders(ContactAutoComplete.java:400)
            at com.zimbra.cs.mailbox.ContactAutoComplete.query(ContactAutoComplete.java:213)
            at com.zimbra.cs.mailbox.ContactRankings.updateContactInfo(ContactRankings.java:125)
            at com.zimbra.cs.mailbox.ContactRankings.increment(ContactRankings.java:117)
            at com.zimbra.cs.mailbox.ContactRankings.increment(ContactRankings.java:65)
            at com.zimbra.cs.mailbox.MailSender.sendMimeMessage(MailSender.java:380)
            at com.zimbra.cs.mailbox.MailSender.sendMimeMessage(MailSender.java:280)
            at com.zimbra.cs.mailbox.MailSender.sendMimeMessage(MailSender.java:237)
            at com.zimbra.cs.service.mail.SendMsg.doSendMessage(SendMsg.java:190)
            at com.zimbra.cs.service.mail.SendMsg.handle(SendMsg.java:150)
            at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEngine.java:418)
            at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:272)
            at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:156)
            at com.zimbra.soap.SoapServlet.doWork(SoapServlet.java:291)
            at com.zimbra.soap.SoapServlet.doPost(SoapServlet.java:212)
            at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
            at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:181)
            at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
            at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
            at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
            at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)
            at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:132)
            at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1148)
            at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:379)
            at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
            at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
            at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
            at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)
            at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
            at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
            at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
            at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
            at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
            at org.mortbay.jetty.handler.DebugHandler.handle(DebugHandler.java:77)
            at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
            at org.mortbay.jetty.Server.handle(Server.java:324)
            at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:525)
            at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:882)
            at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:747)
            at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
            at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:387)
            at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)
            at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:451)
    Going to maintenance mode, deleting the index and restarting seems to be a solution - but I'll first try to delele all the spam mail, then reindex (this box also is the catchall box - may be related ?)

    Or, I'd prefer to have a good way to manage this - turning some logs on, open a bug, post things - so it can be corrected and others don't encounter this (really annoying) problem.

  4. #4
    Join Date
    Apr 2009
    Location
    Beziers, France
    Posts
    11
    Rep Power
    6

    Default

    OK, my update...

    I activate some logs for my user:
    zmprov aal some.one@nowhere.com zimbra.index debug
    zmprov aal some.one@nowhere.com zimbra.op debug
    zmprov aal some.one@nowhere.com zimbra.misc debug
    zmprov aal some.one@nowhere.com zimbra.filter debug
    zmprov aal some.one@nowhere.com zimbra.mailbox debug

    I didn't notice anything special in the logs while searching / using, so I launched a new Reindex from the administration.

    I got some errors (alas, not really more...) and ended like this :

    Code:
    2009-11-11 00:51:08,128 DEBUG [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - indexMailItem(changeId=79243, token=79227-33079)
    2009-11-11 00:51:08,150 DEBUG [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - indexMailItem(changeId=79243, token=79237-33081)
    2009-11-11 00:51:08,150 WARN  [ReIndex-1] [name=some.one@nowhere.com;mid=8;] indexadd - Caught exception while indexing message id 33081 - indexing blocked.  Poss
    ibly corrupt index?
    java.lang.NullPointerException: value cannot be null
            at org.apache.lucene.document.Field.<init>(Field.java:275)
            at org.apache.lucene.document.Field.<init>(Field.java:251)
            at com.zimbra.cs.index.LuceneIndex.addDocument(LuceneIndex.java:200)
            at com.zimbra.cs.index.MailboxIndex.indexMailItem(MailboxIndex.java:513)
            at com.zimbra.cs.mailbox.IndexHelper.indexingPartOfEndTransaction(IndexHelper.java:995)
            at com.zimbra.cs.mailbox.Mailbox.endTransaction(Mailbox.java:6669)
            at com.zimbra.cs.mailbox.IndexHelper.indexItemList(IndexHelper.java:890)
            at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItemsInternal(IndexHelper.java:360)
            at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItems(IndexHelper.java:278)
            at com.zimbra.cs.mailbox.IndexHelper.access$500(IndexHelper.java:54)
            at com.zimbra.cs.mailbox.IndexHelper$ReIndexTask.reIndex(IndexHelper.java:488)
            at com.zimbra.cs.mailbox.IndexHelper$ReIndexTask.run(IndexHelper.java:418)
            at com.zimbra.common.util.ThreadPool$CountedTask.run(ThreadPool.java:136)
            at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
            at java.lang.Thread.run(Thread.java:619)
    2009-11-11 00:51:08,301 DEBUG [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - clearing change
    2009-11-11 00:51:08,302 DEBUG [IndexingCompleted-1] [name=some.one@nowhere.com;mid=8;] mailbox - beginning operation: indexingCompleted
    2009-11-11 00:51:08,302 DEBUG [IndexingCompleted-1] [name=some.one@nowhere.com;mid=8;] mailbox -   fetching new DB connection
    2009-11-11 00:51:08,302 DEBUG [IndexingCompleted-1] [name=some.one@nowhere.com;mid=8;] mailbox - ending operation
    2009-11-11 00:51:08,303 DEBUG [IndexingCompleted-1] [name=some.one@nowhere.com;mid=8;] mailbox - clearing change
    2009-11-11 00:51:08,305 INFO  [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - Deferred Indexing: submitted 13747 items in 466922ms (29.44/sec). (0 items 
    failed to index).  IndexDeferredCount now at 2645 NumNotSubmitted= 2452
    2009-11-11 00:51:08,305 INFO  [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - Re-Indexing: Mailbox 8 COMPLETED in 466935ms
    Let's try...

    ... still no way, Search still doesn't find my recent messages.

    OK, I emptied my Spam and Trash boxes.

    Still not...

    reindexed again...

    And it works !!! I can find my recent mails again...

    Phew...

    If any Zimbra admin is interested, I have a full backup from the server before the 6.0.1 to 6.0.2 upgrade. I also save my mailbox.log for reference.

  5. #5
    Join Date
    Feb 2007
    Location
    Portland, OR
    Posts
    1,147
    Rep Power
    10

    Default

    Yea I thought maybe it was just something strange with my server, but since you are seeing the exact same thing I think I will open a bug report with a message file that causes this attached.

  6. #6
    Join Date
    Feb 2007
    Location
    Portland, OR
    Posts
    1,147
    Rep Power
    10

  7. #7
    Join Date
    Apr 2009
    Location
    Beziers, France
    Posts
    11
    Rep Power
    6

    Default

    Great, thanks !
    Of course my own messages are available if needed. They're also spam messages...

Similar Threads

  1. smtp auth failing 'auth_zimbra: not initialized'
    By kkg039 in forum Administrators
    Replies: 7
    Last Post: 09-05-2013, 11:10 AM
  2. Mail deferred with Connection timed out
    By Miklos Kalman in forum Administrators
    Replies: 7
    Last Post: 11-17-2012, 05:11 AM
  3. mta to not starting
    By cowanpf in forum Installation
    Replies: 2
    Last Post: 10-05-2009, 04:36 AM
  4. Antivirus failing to start in scripted restart
    By dwmtractor in forum Administrators
    Replies: 25
    Last Post: 08-06-2009, 04:33 PM
  5. Replies: 20
    Last Post: 03-18-2008, 05:37 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •