Page 1 of 12 12311 ... LastLast
Results 1 to 10 of 115

Thread: ldap database went from 97meg to 86gig

  1. #1
    Join Date
    Feb 2012
    Posts
    17
    Rep Power
    3

    Default ldap database went from 97meg to 86gig

    I upgraded my zimbra server from 8.0 to 8.01 on Monday of this week.
    No trouble with the upgrade.
    I have for the last 10 mo rsync the main server to a backup server. And only took about 10min.
    After upgrading the main server and the backup server to 8.01. I ran a rsync to the backup server.
    This took about 2hrs. to finish.
    I than again ran a rsync to the backup server and saw that the rsync took the longest to backup was the
    dir /zimbra/data/idap/mdb/db/data.mdb. I than login to the server with wscp and went to that dir. That file was 86 GIG.
    A folder /zimbra/data/idap/mdb/mdb.prev on the date that I upgraded was only 197 meg.
    I am not have any problems with the email server. I am concerned about the 86 GIG file though.
    Now every time I do a rsync to the backup server it takes about 2 hours.
    Does anyone have a clue what is going on?

    Thanks
    Sam

  2. #2
    Join Date
    Feb 2012
    Posts
    17
    Rep Power
    3

    Default

    I fixed the problem.

    I removed the 86 gig file and replaced with the mdb.prev files.


    All seems to be fine. I also rsync the main server to the backup server.

  3. #3
    Join Date
    Feb 2012
    Posts
    17
    Rep Power
    3

    Default

    Ok now that i changed the files from mdb.prev the admin pannel says upgrade avaible. So on my backup server I upgraded the server again. still the same in the admin pannel.
    But from the help menu say 8.01.
    Is there a way to fix this?

  4. #4
    Join Date
    Nov 2012
    Location
    Seattle, WA, US
    Posts
    14
    Rep Power
    2

    Default

    Hi,

    I ran into the exact same problem, except my mdb.prev size was only 6.7 MB and it's now 79 GB.

    What's worse is it's causing my backups to run out of space, so the system's not getting backed up properly.

    I don't know the solution. Has anyone else figured this out?

    Thanks,
    Kevin

  5. #5
    Join Date
    Jun 2011
    Location
    Caracas Venezuela
    Posts
    476
    Rep Power
    4

    Default

    Hi all,

    [root@mail ~]# ls -slth /opt/zimbra/data/ldap/mdb/db/total 3.4M
    4.0K -rw------- 1 zimbra zimbra 8.0K Nov 23 12:03 lock.mdb
    3.4M -rw------- 1 zimbra zimbra 80G Nov 23 12:02 data.mdb
    [root@mail ~]#

    In my test server with 3 user accounts and 10 messages going to 8.0.1, in OpenLDAP Tuning Keys 8.0 - Zimbra :: Wiki explain about the size of data.mdb file.

    But, the installer just checks 5 GB available on disk instead of 85 GB according this new requirement?

    ccelis
    Last edited by ccelis5215; 11-23-2012 at 09:29 AM. Reason: change ls option

  6. #6
    Join Date
    Oct 2005
    Posts
    181
    Rep Power
    10

    Default

    Hi We have a small dev server with a 50GB partition with 8.0.1 on it at it reports 5GB free. A ls -lah at /opt/zimbra/data/ldap/mdb/db/data.mdb tells me the MDB is 80GB... something is not telling us the truth methinks!

  7. #7
    Join Date
    Nov 2012
    Location
    Seattle, WA, US
    Posts
    14
    Rep Power
    2

    Default

    Hi ccelis,

    I just read that document, and what I read it to say was:

    * Default Maximum Size: 85899345920

    * If your database actually reaches that size, data loss will occur (i.e. big problem)

    What the upgrade from 8.0.0 to 8.0.1 did was to increase my data.mdb size to that maximum size--85899345920--that's the exact size of my file. This does not appear to be a new requirement, but on the contrary the document warns of data loss at that size. The implications of this are worse than I originally thought.

    Is there some way to compact the file?

    Thanks,
    Kevin

  8. #8
    Join Date
    Oct 2005
    Posts
    181
    Rep Power
    10

    Default

    This is all a bit worrying we have one 8.0.1 live and a bunch of others scheduled to upgrade. We hadn't noticed this DB size issue as problem before but with something new and unpredictable it does concern us. Doing a copy of the file does indeed take 80GB so not entirely sure what is going on. Any Zimbra bods around looking in today?

  9. #9
    Join Date
    Jun 2011
    Location
    Caracas Venezuela
    Posts
    476
    Rep Power
    4

    Default

    Quote Originally Posted by winepress View Post
    Hi ccelis,

    I just read that document, and what I read it to say was:

    * Default Maximum Size: 85899345920

    * If your database actually reaches that size, data loss will occur (i.e. big problem)

    What the upgrade from 8.0.0 to 8.0.1 did was to increase my data.mdb size to that maximum size--85899345920--that's the exact size of my file. This does not appear to be a new requirement, but on the contrary the document warns of data loss at that size. The implications of this are worse than I originally thought.

    Is there some way to compact the file?

    Thanks,
    Kevin
    Hi, in the same boat that you.

    It seems there's 80GB allocated but just a few megs in use.

    In my case, a FOSS user copying the file takes 80GB. As you have pointed there are two concerns about this issue, at least.

    ccelis.

  10. #10
    Join Date
    Oct 2005
    Posts
    181
    Rep Power
    10

    Default

    Yep, FOSS here too. We are rebuilding a test of the service to see if we can work out why the file is misreporting to the OS. It makes managing storage a problem if you don't know what you don't know ;-) The test environment only has about 15GB of mailbox so proportionately it is very noticeably wrong now.

Similar Threads

  1. Extending LDAP database
    By frost983 in forum Developers
    Replies: 3
    Last Post: 11-02-2010, 07:46 AM
  2. [SOLVED] Zmsetservername choking on ldap database
    By Emmanuel Kasper in forum Administrators
    Replies: 7
    Last Post: 10-21-2009, 10:50 AM
  3. How do I browse Zimbra LDAP database?
    By williamn in forum Administrators
    Replies: 4
    Last Post: 04-16-2008, 02:47 AM
  4. Replies: 0
    Last Post: 01-14-2008, 11:41 AM
  5. change ldap database
    By Grejao in forum Administrators
    Replies: 1
    Last Post: 12-07-2007, 08:39 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •