Results 1 to 5 of 5

Thread: zmbackup more and more slower each week

  1. #1
    Join Date
    Feb 2011
    Location
    France
    Posts
    15
    Rep Power
    4

    Angry zmbackup more and more slower each week

    Each week, we backup our plateform over NFS mount.

    NFS seems to work well. 100MB/s but NICs show that backup is step by step with nothing between 2 account backup.

    Each FullBackup take 2h more than last.

    Compression ZIP is still active.

    zimbra storage are on VMWare plateform with iscsi storage.

    If i active "--noZip" option, this could help ?

    No WARN or ERROR in logs.

    I recent change SWAP move to local ESXi storage, i'll see next saturday if change but on incremental, for the moment, no change.

    iSCSI, FrontEnd and NFS networks are separated.

    Any idea?

    What will happend for next incremental if fullbackup takes more than 24 hours?

    Is there a possibility to see more logs ?

    for exemple, a big account (35 Go, should tank 5"50' for copy) :

    2013-09-21 13:57:21,491 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] backup - redo log file sequence is 197 at full backup for xxxxxxxxx@yyyyyyy.zzz
    2013-09-21 13:57:21,630 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] backup - Full backup started for account xxxxxxxxx@yyyyyyy.zzz (aaaaaaaa-bbbb-cccc-dddd-eeeeeeeeeeee) mailbox 1276
    2013-09-21 13:57:21,630 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] mailbox - Putting mailbox 1276 under maintenance.
    2013-09-21 13:57:36,289 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] sqltrace - Slow execution (14658ms): SELECT id, mod_content, blob_digest FROM mboxgroup76.mail_item WHERE mailbox_id = 1276
    2013-09-21 13:57:38,547 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] backup - Number of blobs to backup for mailbox 1276: 175606
    2013-09-21 13:57:38,547 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] mailbox - Ending maintenance on mailbox 1276.
    2013-09-21 13:57:38,547 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] mbxmgr - Mailbox 1276 account aaaaaaaa-bbbb-cccc-dddd-eeeeeeeeeeee AVAILABLE
    2013-09-21 14:29:18,619 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] backup - Account xxxxxxxxx@yyyyyyy.zzz in backup set full-20130920.230008.040: All pending file IO completed (176184 out of 176184)
    2013-09-21 14:29:18,832 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] mailbox - Putting mailbox 1276 under maintenance.
    2013-09-21 14:29:18,858 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] backup - Found 2 blobs that were created/updated after backup began for mailbox 1276
    2013-09-21 14:29:53,010 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] backup - Account xxxxxxxxx@yyyyyyy.zzz in backup set full-20130920.230008.040: All pending file IO completed (176212 out of 176212)
    2013-09-21 14:29:54,133 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] mailbox - Ending maintenance on mailbox 1276.
    2013-09-21 14:29:54,133 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] mbxmgr - Mailbox 1276 account aaaaaaaa-bbbb-cccc-dddd-eeeeeeeeeeee AVAILABLE
    2013-09-21 14:29:54,133 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] backup - Account xxxxxxxxx@yyyyyyy.zzz in backup set full-20130920.230008.040: All pending file IO completed (176212 out of 176212)
    2013-09-21 14:29:54,133 INFO [FullBackupThread] [name=xxxxxxxxx@yyyyyyy.zzz;mid=1276;] backup - Full backup finished for account xxxxxxxxx@yyyyyyy.zzz (aaaaaaaa-bbbb-cccc-dddd-eeeeeeeeeeee) mailbox 1276

    67040 38 drwxr-x--- 5 root wheel 8 Sep 24 01:00 .
    67041 38 drwxr-x--- 2 root wheel 6 Sep 21 14:30 ./blobs
    67046 15708001 -rw-r----- 1 root wheel 9078217404 Sep 21 14:30 ./blobs/blobs-3.zip
    67048 15857815 -rw-r----- 1 root wheel 9043564293 Sep 21 14:30 ./blobs/blobs-4.zip
    67044 15823776 -rw-r----- 1 root wheel 9053941897 Sep 21 14:30 ./blobs/blobs-2.zip
    67042 16343676 -rw-r----- 1 root wheel 9274540327 Sep 21 14:30 ./blobs/blobs-1.zip
    67052 38 drwxr-x--- 3 root wheel 3 Sep 21 14:29 ./index
    67053 38 drwxr-x--- 2 root wheel 28 Sep 21 14:30 ./index/0
    67072 148006 -rw-r----- 1 root wheel 99155264 Sep 21 14:30 ./index/0/_49h.cfs
    67086 19 -rw-r----- 1 root wheel 21607 Sep 21 14:29 ./index/0/_1s7_16.del
    67058 38 -rw-r----- 1 root wheel 22392 Sep 21 14:29 ./index/0/_uv_c.del
    67087 395827 -rw-r----- 1 root wheel 262764750 Sep 21 14:30 ./index/0/_uv.cfs
    67062 38 -rw-r----- 1 root wheel 16486 Sep 21 14:29 ./index/0/_3ec_1o.del
    67057 1006 -rw-r----- 1 root wheel 980532 Sep 21 14:29 ./index/0/_73z.fdx
    67063 76709 -rw-r----- 1 root wheel 51098756 Sep 21 14:30 ./index/0/_73z.frq
    67064 19 -rw-r----- 1 root wheel 256 Sep 21 14:29 ./index/0/_73z.fnm
    67061 38 -rw-r----- 1 root wheel 14613 Sep 21 14:29 ./index/0/_5oa_6.del
    67056 141224 -rw-r----- 1 root wheel 93666913 Sep 21 14:30 ./index/0/_73z.prx
    67060 19 -rw-r----- 1 root wheel 15351 Sep 21 14:29 ./index/0/_73z_11.del
    67079 251642 -rw-r----- 1 root wheel 181593488 Sep 21 14:30 ./index/0/_1s7.cfs
    67066 26545 -rw-r----- 1 root wheel 17738121 Sep 21 14:29 ./index/0/_7hw.cfs
    67054 223380 -rw-r----- 1 root wheel 154618554 Sep 21 14:30 ./index/0/_5oa.cfs
    67089 129 -rw-r----- 1 root wheel 79181 Sep 21 14:29 ./index/0/_7k8.cfs
    67090 2103 -rw-r----- 1 root wheel 1334250 Sep 21 14:29 ./index/0/_7k6.cfs
    67080 2889 -rw-r----- 1 root wheel 1869528 Sep 21 14:29 ./index/0/_7jb.cfs
    67100 458 -rw-r----- 1 root wheel 217615 Sep 21 14:30 ./index/0/_73z.tii
    67059 19 -rw-r----- 1 root wheel 20 Sep 21 14:29 ./index/0/segments.gen
    67065 4590 -rw-r----- 1 root wheel 6615768 Sep 21 14:29 ./index/0/_73z.fdt
    67071 1537 -rw-r----- 1 root wheel 2941588 Sep 21 14:29 ./index/0/_73z.nrm
    67055 147 -rw-r----- 1 root wheel 94125 Sep 21 14:29 ./index/0/_7k7.cfs
    67088 28776 -rw-r----- 1 root wheel 18426087 Sep 21 14:30 ./index/0/_73z.tis
    67078 19 -rw-r----- 1 root wheel 1690 Sep 21 14:29 ./index/0/segments_5zu
    67091 250125 -rw-r----- 1 root wheel 167855086 Sep 21 14:30 ./index/0/_3ec.cfs
    67069 38 -rw-r----- 1 root wheel 8968 Sep 21 14:29 ./index/0/_49h_1c.del
    67051 38 drwxr-x--- 2 root wheel 12 Sep 21 14:30 ./db
    67070 129 -r--r--r-- 1 root wheel 117139 Sep 21 14:29 ./db/mailbox_metadata.dat
    67095 74 -r--r--r-- 1 root wheel 58620 Sep 21 14:30 ./db/tombstone.dat
    67075 19 -r--r--r-- 1 root wheel 188 Sep 21 14:29 ./db/mobile_devices.dat
    67085 1994 -r--r--r-- 1 root wheel 2767930 Sep 21 14:29 ./db/tagged_item.dat
    67093 38 -r--r--r-- 1 root wheel 12408 Sep 21 14:30 ./db/appointment.dat
    67077 102321 -r--r--r-- 1 root wheel 82959939 Sep 21 14:29 ./db/mail_item.dat
    67068 19 -r--r--r-- 1 root wheel 162 Sep 21 14:29 ./db/mailbox.dat
    67084 19 -r--r--r-- 1 root wheel 757 Sep 21 14:29 ./db/tag.dat
    67092 166 -r--r--r-- 1 root wheel 96664 Sep 21 14:30 ./db/open_conversation.dat
    67067 38 -rw-r----- 1 root wheel 19321 Sep 21 14:29 ./db/db_schema.xml
    67050 19 -rw-r----- 1 root wheel 4759 Sep 21 14:29 ./ldap.xml
    91138 19 -rw-r----- 2 root wheel 4759 Sep 24 01:00 ./ldap_latest.xml
    67101 19 -rw-r----- 1 root wheel 655 Sep 21 14:30 ./meta.xml


    Thanks a lot,

    Best regards,
    Already 6 years of Zimbra NE and always Happy
    Release 8.0.4.GA.5737.UBUNTU12.64 UBUNTU12_64 NETWORK edition, Patch 8.0.4_P1.

  2. #2
    Join Date
    Feb 2011
    Location
    France
    Posts
    15
    Rep Power
    4

    Default

    I've try benchmark of san. no slower than before.

    Do you need more information?
    Already 6 years of Zimbra NE and always Happy
    Release 8.0.4.GA.5737.UBUNTU12.64 UBUNTU12_64 NETWORK edition, Patch 8.0.4_P1.

  3. #3
    Join Date
    Feb 2011
    Location
    France
    Posts
    15
    Rep Power
    4

    Default

    is nobody ?
    Already 6 years of Zimbra NE and always Happy
    Release 8.0.4.GA.5737.UBUNTU12.64 UBUNTU12_64 NETWORK edition, Patch 8.0.4_P1.

  4. #4
    Join Date
    Apr 2008
    Location
    New Paltz, NY
    Posts
    336
    Rep Power
    7

    Default

    I switched to having our backup store on NFS (instead of iSCSI) several months ago. It made the Zimbra backup process slower, but makes our backup of the backup (via Veeam) considerably faster.

    As for the noZip option, I think that would speed it up. Mail that already exists in a previous backup is hardlinked. Though there is no compression done, this saves us storage and makes the backup quicker. Your results may vary though.
    ---
    Paul Chauvet
    State University of New York at New Paltz

  5. #5
    Join Date
    Feb 2011
    Location
    France
    Posts
    15
    Rep Power
    4

    Default

    Thank you chauvetp for you answer!

    I'll try noZip option for the next backup. I'm already on NFS for backup. THANKS !!
    Is there a problem to pass from "no noZip" to "noZip"?

    Thanks you.
    Already 6 years of Zimbra NE and always Happy
    Release 8.0.4.GA.5737.UBUNTU12.64 UBUNTU12_64 NETWORK edition, Patch 8.0.4_P1.

Similar Threads

  1. Replies: 37
    Last Post: 06-02-2014, 02:58 PM
  2. Replies: 1
    Last Post: 05-02-2013, 09:21 AM
  3. Print Email suddenly 10x slower
    By ardichoke in forum Administrators
    Replies: 1
    Last Post: 01-17-2013, 09:51 AM
  4. 5.0.13 is much slower
    By dagar in forum Administrators
    Replies: 5
    Last Post: 02-11-2009, 04:16 PM
  5. Replies: 1
    Last Post: 02-21-2006, 05:25 PM

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •