Results 1 to 10 of 10

Thread: memcached

Hybrid View

  1. #1
    Join Date
    Sep 2005
    Posts
    95
    Rep Power
    10

    Default memcached

    Hi all,

    We have a lot of memcached (http://www.danga.com/memcached) servers around (to run our MediaWiki) and we really want to use them together with Zimbra. Is it possible? If yes, how? We can hack the code ourselves.

    -g.

  2. #2
    Join Date
    Aug 2005
    Location
    San Mateo, CA
    Posts
    4,789
    Rep Power
    19

    Default

    Since all the action/caching is in the server I guess this is where you would want to try to put it in. I'm not sure how much it would help though. We already partition the data similar to memcached. So we don't cache the same object in more than one place like other apps would do. A user's mailbox is on one DB and cached by it's local tomcat instance.

  3. #3
    Join Date
    Sep 2005
    Posts
    95
    Rep Power
    10

    Default

    Quote Originally Posted by KevinH
    Since all the action/caching is in the server I guess this is where you would want to try to put it in. I'm not sure how much it would help though. We already partition the data similar to memcached. So we don't cache the same object in more than one place like other apps would do. A user's mailbox is on one DB and cached by it's local tomcat instance.
    Yes, we want to implement memcached in the Zimbra server side. What we really want to cache is all the user information stored in LDAP. As I say in this thread http://www.zimbra.com/forums/showthr...?p=775#post775, we have bad performance problems with LDAP and in our current setup, we use nscd together with memcached to solve them. They help us pretty well, 50-70% LDAP connections are served directly by the local nscd/memcached server. We see no way to use nscd together with Zimbra so only memcached may help.

    Our plan is to make memcached become something like zimbra-cached, that means it's will be intergrated to the installer and users can choose whether to install it. If yes, they will be asked for some configuration information (how much RAM, the IP, the port...) and after that Zimbra will automatically be configured to use memcached.

    The Java Client API for memcached is available at http://www.whalin.com/memcached/. We havent used it before but it seems to be in active development. Its license is LGPL.

    What should we do? Please advise.

    -g

  4. #4
    Join Date
    Aug 2005
    Location
    San Mateo, CA
    Posts
    4,789
    Rep Power
    19

    Default

    Take a look at:

    /ZimbraServer/src/java/com/zimbra/cs/account/ldap/LdapProvisioning.java

    You'll see the LDAP related caches we create. Currently we use a LRU cache.

  5. #5
    Join Date
    Sep 2005
    Posts
    95
    Rep Power
    10

    Default

    Ok thx Kevin, we will dive into the code and tell you the result later. Thx again.

    Best regards,

    -g

  6. #6
    Join Date
    Sep 2005
    Posts
    95
    Rep Power
    10

    Default

    Hey Kevin,

    As your suggestion, today I take a look at /ZimbraServer/src/java/com/zimbra/cs/account/ldap/LdapProvisioning.java (many thx to the Eclipse team for the wonderful Java Browsing perspective ).

    After browsing a while, I think that memcached may help, especially for caching LDAP data. As far as I know, you havent got a centralized cache storage because each LRU cache is only available to its local zimbra-store. So there're probably objects stored the same in multiple zimbra-store servers. If we just have only one zimbra-store server, there's no benefit in using memcached but in a (very) large scale (as the one I'm going to deploy), memcached does help a lot.

    Do you have any plan to integrate memcached into zimbra? I think it wont take a lot of time. I can hack myself but I wonder whether you will integrate it to zimbra. I just dont want to use a heavy-patched Zimbra version (and busy patching when you guys release a new version with a lot of cool features!). Please advise.

    -g.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •