Help!!

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
tbridge
Posts: 30
Joined: Fri Sep 12, 2014 10:08 pm

Help!!

Postby tbridge » Mon Jun 12, 2006 9:49 am

Gang,
I got a panicked call from one of our admins this morning, saying she couldn't get into her email. I tried to login remotely, both via SSH and via Timbuktu, to the now frozen mail server, and was unable to do so. We eventually did the thing server admins fear and shut it down hard (power button for 10 seconds does this admirably on the OS X side)
Now, however, many messages produce this error:
msg - system failure: missing blob for id: 3880, change: 6119

com.zimbra.cs.service.ServiceException: system failure: missing blob for id: 3880, change: 6119
or something similar.
Reading the forums, this sounds like catastrophe, and is going to require a good amount of effort on our part to resurrect things. Is there another way?
Best,
Tom


tbridge
Posts: 30
Joined: Fri Sep 12, 2014 10:08 pm

Help!!

Postby tbridge » Mon Jun 12, 2006 10:05 am

Here is the log prior to the issue appearing:
2006-06-12 10:26:30,580 INFO [LmtpServer-3] [name=rclark@clarkandcollins.com;] FileBlobStore - Linked id=3921 mbox=2 oldpath=/Volumes/MailStore/store/incoming/1150122388954-5.msg newpath=/Volumes/MailStore/store/0/2/msg/0/3921-6201.msg

2006-06-12 10:26:30,595 INFO [LmtpServer-3] [name=rclark@clarkandcollins.com;] mailbox - Added message id=3921 digest=oI+iYxqHmIxV0V+qMoOmeFM+rSo= mailbox=2 rcpt=rclark@clarkandcollins.com

2006-06-12 10:26:30,610 INFO [LmtpServer-3] [name=rclark@clarkandcollins.com;] mailbox - outofoffice sent dest='do-not-reply-P2608109@clarkandcollins.seework.com' rcpt='rclark@clarkandcollins.com' mid=3921

2006-06-12 10:26:30,617 INFO [LmtpServer-3] [name=sking@clarkandcollins.com;] cache - Initializing folder and tag caches for mailbox 7

2006-06-12 10:26:30,747 INFO [LmtpServer-3] [name=sking@clarkandcollins.com;] FileBlobStore - Linked id=500 mbox=7 oldpath=/Volumes/MailStore/store/incoming/1150122388954-5.msg newpath=/Volumes/MailStore/store/0/7/msg/0/500-600.msg

2006-06-12 10:26:30,756 INFO [LmtpServer-3] [name=sking@clarkandcollins.com;] mailbox - Added message id=500 digest=oI+iYxqHmIxV0V+qMoOmeFM+rSo= mailbox=7 rcpt=sking@clarkandcollins.com

2006-06-12 10:26:30,757 INFO [LmtpServer-3] [] FileBlobStore - deleting blob file (path=/Volumes/MailStore/store/incoming/1150122388954-5.msg, vol=4)

2006-06-12 10:27:08,292 INFO [IndexWritersSweeper] [] MailboxIndex - open index writers sweep: before=7, closed=0, after=7 (0ms)

2006-06-12 10:27:08,580 INFO [Timer-0] [] stats - 06/12/2006 10:27:08,6,140346,12,12,168192,26,40.31,17,3.82,12,1230.42,,0.80,,,,,,,3.00,35.768,0,31,12,4,447,133,,0,0,0,0

2006-06-12 10:28:08,292 INFO [IndexWritersSweeper] [] MailboxIndex - open index writers sweep: before=7, closed=0, after=7 (0ms)

2006-06-12 10:28:08,498 INFO [Timer-0] [] stats - 06/12/2006 10:28:08,,,,,,16,0.69,12,0.33,,,0.00,0.14,15,93.20,,,,,,49.564,0,33,12,4,457,141,,0,0,0,0

2006-06-12 10:28:09,334 INFO [LmtpServer-1] [] LmtpHandler - [66.208.41.214] quit from client

2006-06-12 10:28:09,337 INFO [LmtpServer-1] [] ProtocolHandler - Handler exiting normally

2006-06-12 10:28:09,336 INFO [LmtpServer-2] [] LmtpHandler - [66.208.41.214] quit from client

2006-06-12 10:28:09,338 INFO [LmtpServer-2] [] ProtocolHandler - Handler exiting normally

2006-06-12 10:28:09,338 INFO [LmtpServer-5] [] LmtpHandler - [66.208.41.214] quit from client

2006-06-12 10:28:09,338 INFO [LmtpServer-5] [] ProtocolHandler - Handler exiting normally

2006-06-12 10:28:09,339 INFO [LmtpServer-4] [] LmtpHandler - [66.208.41.214] quit from client

2006-06-12 10:28:09,340 INFO [LmtpServer-4] [] ProtocolHandler - Handler exiting normally

2006-06-12 10:28:10,341 INFO [LmtpServer-3] [] LmtpHandler - [66.208.41.214] quit from client

2006-06-12 10:28:10,341 INFO [LmtpServer-3] [] ProtocolHandler - Handler exiting normally

2006-06-12 10:28:12,975 INFO [http-80-Processor99] [mid=5;ip=66.208.41.210;name=mabejuela@clarkandcollins.com;] SoapEngine - handler exception

com.zimbra.cs.service.ServiceException: system failure: missing blob for id: 825, change: 1207

at com.zimbra.cs.service.ServiceException.FAILURE(ServiceException.java:131)

at com.zimbra.cs.mailbox.MailItem.getBlob(MailItem.java:669)

at com.zimbra.cs.mailbox.MessageCache.fetchFromStore(MessageCache.java:189)
jholder
Zimbra Employee
Zimbra Employee
Posts: 4686
Joined: Fri Sep 12, 2014 10:00 pm

Help!!

Postby jholder » Mon Jun 12, 2006 7:09 pm

Actually, I think it's pretty recoverable.
You may look a mailbox or 5, but I think it's possible.
So, do you have a recent backup? If so, then try a reinstall.
tbridge
Posts: 30
Joined: Fri Sep 12, 2014 10:08 pm

Help!!

Postby tbridge » Mon Jun 12, 2006 8:44 pm

It was kind of the perfect storm, really.
When the server crashed, the RAID that holds the mail didn't come back. Zimbra saw this as a sign of Something Wrong and created a new /Volumes/MailStore and started stuffing mail into it as it came in. The hardest part was figuring out that MailStore (created by Zimbra) and MailStore (mounted on the desktop, but actually MailStore 1 to the File System) were not the same thing and then combining them.
Thanks VERY much to Mark and Celeste at Zimbra for their help today, and I'm glad to now be a Network Edition customer.
jholder
Zimbra Employee
Zimbra Employee
Posts: 4686
Joined: Fri Sep 12, 2014 10:00 pm

Help!!

Postby jholder » Tue Jun 13, 2006 8:51 pm

They is good peoples... :D
FunkyPenguin
Advanced member
Advanced member
Posts: 140
Joined: Fri Sep 12, 2014 10:02 pm

Help!!

Postby FunkyPenguin » Fri Sep 01, 2006 4:40 am

[quote]Actually, I think it's pretty recoverable.
You may look a mailbox or 5, but I think it's possible.
So, do you have a recent backup? If so, then try a reinstall.[/QUOTE]


wannabetenor
Sorry for my ignorance but what do you mean exactly? I'm having simmilar issues - different reason (see here ). Unfortunately I don't have a good backup :o

Return to “Administrators”

Who is online

Users browsing this forum: No registered users and 13 guests