Page 1 of 2 12 LastLast
Results 1 to 10 of 20

Thread: Zimbra OSE backup without stopping the services

  1. #1
    Join Date
    Oct 2009
    Posts
    42
    Rep Power
    5

    Default Zimbra OSE backup without stopping the services

    Hi all,

    we have a problem: we must set a backup procedure for our zimbra open source edition, single server installation.

    All of the procedures i've seen needs to stop the services for the entire backup operation; this is unacceptable for us because our /opt/zimbra directory is 30gb big, and a simple local rsync process takes 1:30 hours to complete.

    We cannot take the server down for that period, so i ask you if there's an alternative procedure to backup the server without stopping services or stopping them for a little time period.

    Thank you.

  2. #2
    Join Date
    Nov 2006
    Location
    UK
    Posts
    8,017
    Rep Power
    24

    Default

    LVM and splitting a mirror ?

  3. #3
    Join Date
    Oct 2009
    Posts
    42
    Rep Power
    5

    Default

    but with lvm i must stop the services anyway isnt'it? that's my problem, i cannot stop services...

  4. #4
    Join Date
    Nov 2006
    Location
    UK
    Posts
    8,017
    Rep Power
    24

    Default

    stopping them for a little time period
    stop the services, split the mirror, and start them again.

  5. #5
    Join Date
    Oct 2009
    Posts
    42
    Rep Power
    5

    Default

    sorry for this, but please could you specify in a better way what you're meaning for "split the mirror".

    thanks a lot.

  6. #6
    Join Date
    Oct 2009
    Location
    Dublin, IRELAND
    Posts
    712
    Rep Power
    6

    Default

    If you look at the script in this thread

    [SOLVED] Yet Another Backup Script for Community Version

    it does stop the services - but - for a very short period of time.

    It does an rsync while the services are running - to get most of the backup data in place - then stops the services and does a second rsync to backup the remaining files that changed since the first rsync was begun.

    At that point it restarts the mail services before actually performing the rest of the backup processes - in this case using dar and remote copy.

    In my case - with approx 1.8GB of mailbox data the mail is offline for 2 mins and 10 seconds. I'm not sure how much the size of mailbox data affects the startup times.

  7. #7
    Join Date
    Oct 2005
    Location
    USA, Canada and India
    Posts
    777
    Rep Power
    10

    Default

    You only need 2-3 min of service stop/start time no matter if you have Tera bytes of data..
    key is to rsync multiple times to shorten the "delta" sync when you stop services.
    i.e:
    rsync
    rysnc
    rysnc
    ..
    stop services
    rsync
    start services

    or go vmware route and if you have correct vmware lisence you can take HOT backup of full VM any times you like, VCB/Stoarge API can do incremental backups too..
    if you have large number of users and OSS version fuctions are enough for you then vmware + OSS will cost less than just NE with Backup for same amount of users..much less

    Raj
    Raj
    i2k2 Networks
    Dedicated & Shared Zimbra Hosting Provider

  8. #8
    Join Date
    Oct 2009
    Posts
    42
    Rep Power
    5

    Default

    Quote Originally Posted by liverpoolfcfan View Post
    If you look at the script in this thread

    [SOLVED] Yet Another Backup Script for Community Version

    it does stop the services - but - for a very short period of time.

    It does an rsync while the services are running - to get most of the backup data in place - then stops the services and does a second rsync to backup the remaining files that changed since the first rsync was begun.

    At that point it restarts the mail services before actually performing the rest of the backup processes - in this case using dar and remote copy.

    In my case - with approx 1.8GB of mailbox data the mail is offline for 2 mins and 10 seconds. I'm not sure how much the size of mailbox data affects the startup times.
    thank you a lot man, i'll check it out

  9. #9
    Join Date
    Jun 2008
    Location
    Berkeley, CA
    Posts
    1,474
    Rep Power
    9

    Default

    Quote Originally Posted by raj View Post
    You only need 2-3 min of service stop/start time no matter if you have Tera bytes of data..
    key is to rsync multiple times to shorten the "delta" sync when you stop services.
    i.e:
    rsync
    rysnc
    rysnc
    ..
    stop services
    rsync
    start services
    If I can piggyback on this thread--even though I use NE--my experience is that rsync can take a while even if you've already copied most of the data. Why? Because there's so much to compare before the copying occurs. Or am I doing something wrong?

  10. #10
    Join Date
    Oct 2005
    Location
    USA, Canada and India
    Posts
    777
    Rep Power
    10

    Default

    sample backup log for our custom backup script for ~100GB actual data in this server..only have zimbra + 600MB plain centos install.
    [root@zimbraXXX ~]# df -h
    Filesystem Size Used Avail Use% Mounted on
    /dev/sda3 202G 93G 99G 49% /
    /dev/sda1 99M 17M 78M 18% /boot
    tmpfs 1014M 0 1014M 0% /dev/shm

    Thu Mar 25 02:46:57 EDT 2010 : Backup Process Started
    Thu Mar 25 02:46:57 EDT 2010 : Zimbra Mysql Databases Backup Dump Started
    Thu Mar 25 02:49:51 EDT 2010 : Zimbra Mysql Databases Backup Dump Finished
    Thu Mar 25 02:49:51 EDT 2010 : Zimbra Mysql Databases Backup Dump Time Taken: 0 hours 2 minutes 54 seconds
    Thu Mar 25 02:49:51 EDT 2010 : Zimbra LDAP Databases Backup Dump Started
    Thu Mar 25 02:49:56 EDT 2010 : Zimbra LDAP Databases Backup Dump Finished
    Thu Mar 25 02:49:56 EDT 2010 : Zimbra LDAP Databases Backup Dump Time Taken: 0 hours 0 minutes 5 seconds
    Thu Mar 25 02:49:56 EDT 2010 : Initial File Sync Started
    Thu Mar 25 02:56:16 EDT 2010 : Initial File Sync Last 2 Log Lines:
    sent 938450506 bytes received 4275600 bytes 2477598.18 bytes/sec
    total size is 147472277364 speedup is 156.43
    Thu Mar 25 02:56:16 EDT 2010 : Initial File Sync Finished
    Thu Mar 25 02:56:16 EDT 2010 : Initial File Sync Time Taken: 0 hours 6 minutes 20 seconds
    Thu Mar 25 02:56:16 EDT 2010 : Second File Sync Started
    Thu Mar 25 02:59:23 EDT 2010 : Second File Sync Last 2 Log Lines:
    sent 50608948 bytes received 1235691 bytes 276504.74 bytes/sec
    total size is 147476019978 speedup is 2844.58
    Thu Mar 25 02:59:23 EDT 2010 : Second File Sync Finished
    Thu Mar 25 02:59:23 EDT 2010 : Second File Sync Time Taken: 0 hours 3 minutes 7 seconds
    Thu Mar 25 02:59:23 EDT 2010 : Stopping Zimbra Services
    Host zimbra3.ocpwebserver.com
    Stopping stats...Done
    Stopping mta...Done
    Stopping spell...Done
    Stopping snmp...Done
    Stopping archiving...Done
    Stopping antivirus...Done
    Stopping antispam...Done
    Stopping imapproxy...Done
    Stopping mailbox...Done
    Stopping logger...Done
    Stopping ldap...Done
    Thu Mar 25 03:00:34 EDT 2010 : Incremental File Sync Started
    Thu Mar 25 03:03:42 EDT 2010 : Incremental File Sync Last 2 Log Lines:
    sent 150317644 bytes received 1634886 bytes 806114.22 bytes/sec
    total size is 150554389283 speedup is 990.80
    Thu Mar 25 03:03:42 EDT 2010 : Incremental File Sync Ended
    Thu Mar 25 03:03:42 EDT 2010 : Services Stopped to do Incremental File Sync for : 0 hours 4 minutes 19 seconds
    Thu Mar 25 03:03:42 EDT 2010 : Starting Zimbra Services
    Host zimbra3.ocpwebserver.com
    Starting ldap...Done.
    Starting logger...Done.
    Starting mailbox...Done.
    Starting antispam...Done.
    Starting antivirus...Done.
    Starting snmp...Done.
    Starting spell...Done.
    Starting mta...Done.
    Starting stats...Done.
    Thu Mar 25 03:05:02 EDT 2010 : Checking Zimbra Services
    Host zimbra3.ocpwebserver.com
    antispam Running
    antivirus Running
    ldap Running
    logger Running
    mailbox Running
    mta Running
    snmp Running
    spell Running
    stats Running
    Thu Mar 25 03:05:10 EDT 2010 : Backup Process Ended
    Thu Mar 25 03:05:10 EDT 2010 : Total Time Taken: 0 hours 18 minutes 13 seconds
    Thu Mar 25 03:05:10 EDT 2010 : -----------------------------------------------------
    Raj
    i2k2 Networks
    Dedicated & Shared Zimbra Hosting Provider

Similar Threads

  1. postfix relay=none status=bounced for local mails
    By vdd in forum Administrators
    Replies: 1
    Last Post: 08-06-2009, 08:05 AM
  2. Zimbra Open Source Backup Help
    By ayush1440 in forum Administrators
    Replies: 8
    Last Post: 11-13-2008, 03:56 AM
  3. /tmp filling
    By Nutz in forum Administrators
    Replies: 8
    Last Post: 02-22-2008, 01:00 AM
  4. Replies: 8
    Last Post: 02-27-2007, 03:10 AM
  5. Unable to start tomcat
    By chanck in forum Administrators
    Replies: 11
    Last Post: 06-11-2006, 12:58 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •