zmdedupe

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
aiko
Posts: 14
Joined: Fri Sep 12, 2014 11:40 pm

zmdedupe

Postby aiko » Thu Oct 12, 2017 3:03 pm

Hello,

has anybody of you tried zmdedupe? Or does somebody run it regularly?
Is it safe? Or have tears been shed later?

Kind regards,
Aiko


phoenix
Ambassador
Ambassador
Posts: 25154
Joined: Fri Sep 12, 2014 9:56 pm

Re: zmdedupe

Postby phoenix » Thu Oct 12, 2017 3:33 pm

Why do you think it necessary to run it on any sort of basis? If you want to see who's used it the put the word into the search bar, top right, and read what people say about it or you could always do an internet search for a few different results. ;)
Regards

Bill

Rspamd: A high performance spamassassin replacement

If you'd like to see this implemented in a future version of ZCS then please vote on Bugzilla entries 97706 & 108168
aiko
Posts: 14
Joined: Fri Sep 12, 2014 11:40 pm

Re: zmdedupe

Postby aiko » Fri Oct 13, 2017 10:26 am

Hello Phoenix,

I searched the internet of course and the results were sobering.

In 2014, somebody mentioned, that it doesn't work for secondary volumes:
https://bugzilla.zimbra.com/show_bug.cgi?id=87915
(We don't have secondary volumes anymore luckily.)

In 2015, somebody asked for some documention:
https://bugzilla.zimbra.com/show_bug.cgi?id=102069
(Yeah. And that's it. Story ends here.)

I would like to ask some of our users to put ~100GB of mails back on the Zimbra server. Those mails are currently on a different IMAP server. And I guess, that I actually do not need additional 100GB of disk storage because of zmdedupe. Those mails were originally stored on the Zimbra server and I expect, that somebody still has them in his/her mailbox as a copy. Our server contains 1.6TB of mails at the moment.

But is it possible to let zmdedupe run at any time? Does it hit performance hard? Stay all mailboxes online during that time? I could not find an answer.

Different story: I needed zmrestore once and immediately triggered two bugs, that were at least documented in Bugzilla. That is why I am asking. Does anybody use zmdedupe regularly or is it some forgotten tool that may or not may eat all our emails? :)

Kind regards,
Aiko
User avatar
L. Mark Stone
Elite member
Elite member
Posts: 1572
Joined: Wed Oct 09, 2013 11:35 am
Location: Portland, Maine
ZCS/ZD Version: 8.6.0 Patch 8
Contact:

Re: zmdedupe

Postby L. Mark Stone » Fri Oct 13, 2017 11:42 am

aiko wrote:Hello Phoenix,

I searched the internet of course and the results were sobering.

In 2014, somebody mentioned, that it doesn't work for secondary volumes:
https://bugzilla.zimbra.com/show_bug.cgi?id=87915
(We don't have secondary volumes anymore luckily.)

In 2015, somebody asked for some documention:
https://bugzilla.zimbra.com/show_bug.cgi?id=102069
(Yeah. And that's it. Story ends here.)

I would like to ask some of our users to put ~100GB of mails back on the Zimbra server. Those mails are currently on a different IMAP server. And I guess, that I actually do not need additional 100GB of disk storage because of zmdedupe. Those mails were originally stored on the Zimbra server and I expect, that somebody still has them in his/her mailbox as a copy. Our server contains 1.6TB of mails at the moment.

But is it possible to let zmdedupe run at any time? Does it hit performance hard? Stay all mailboxes online during that time? I could not find an answer.

Different story: I needed zmrestore once and immediately triggered two bugs, that were at least documented in Bugzilla. That is why I am asking. Does anybody use zmdedupe regularly or is it some forgotten tool that may or not may eat all our emails? :)

Kind regards,
Aiko


We use zmdedupe frequently on 8.6 and above with no tears.

It is very useful when you have a multi-server Zimbra installation and are moving mailboxes across mailbox servers, and after restoring a mailbox you intend to keep.

Keep in mind however that it won't find everything that can be deduped; to my understanding it uses a cache of a few thousand items.

We learned this the hard way when we were doing a Zimbra upgrade. We upgraded the LDAP, MTA and Proxy hosts in place, but to avoid downtime for the users, we built new mailbox servers and just moved mailboxes from the old mailbox servers to the new mailbox servers. There were about 1K mailboxes on each mailbox server. After the moves were done, we ran zmdedupe, but found we were still using about 20% more storage on the new servers than on the old. After that, we started running zmdedupe after every 100 or so mailbox moves and got slightly better results.

The functionality within the Zextras Suite (coming in Zimbra 8.8) is better I'm told.

Hope that helps,
Mark
________________________________________________
L. Mark Stone, General Manager
reliable networks, a Division of OTT Communications
HIPAA-Compliant Zimbra Hosting Provider since 2006 http://www.reliablenetworks.com
Zeta Alliancehttp://www.zetalliance.org/

Return to “Administrators”

Who is online

Users browsing this forum: No registered users and 63 guests