[SOLVED] java process at 180%

[jerryboi]

I had a situation where my server has gotten really sloooooooow, apparently from a java process:

$ top

top - 10:47:24 up 4 days,  9:00,  1 user,  load average: 6.05, 6.47, 6.43

Tasks: 159 total,   1 running, 158 sleeping,   0 stopped,   0 zombie

Cpu(s): 90.8%us,  3.5%sy,  4.2%ni,  0.8%id,  0.0%wa,  0.2%hi,  0.5%si,  0.0%st

Mem:   3107192k total,  2935744k used,   171448k free,   167248k buffers

Swap:  4096564k total,       68k used,  4096496k free,  1037672k cached
  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND    

 4353 zimbra    18   0  872m 674m  12m S 180.3 22.2   1908:18 java                                                               

17884 root      36  19 26908  14m 5936 S 10.1  0.5   0:00.56 yum-updatesd-he                                                     

  547 root      11  -5     0    0    0 S  0.3  0.0   6:53.81 kjournald                                                           

 2479 dbus      15   0  2848  948  744 S  0.3  0.0   0:00.51 dbus-daemon                                                         

 2598 haldaemo  15   0  6224 4212 1612 S  0.3  0.1   1:07.80 hald                                                                

 2882 zimbra    18   0  226m  43m 4616 S  0.3  1.4   3:19.55 slapd                                                               

 4299 zimbra    15   0  706m 125m 4400 S  0.3  4.1   4:10.02 mysqld                                                              

    1 root      15   0  2160  640  548 S  0.0  0.0   0:03.03 init                                                                

    2 root      RT  -5     0    0    0 S  0.0  0.0   0:16.92 migration/0                                                         

    3 root      34  19     0    0    0 S  0.0  0.0   0:00.21 ksoftirqd/0                                                         

    4 root      RT  -5     0    0    0 S  0.0  0.0   0:12.45 migration/1  

I have restarded and it seems to have gone away. Would be nice to be alerted when this happens again. Any suggestions how to monitor this behavior?

[theboina]

Version of Zimbra? SO?

[fyd]

[quote user="jerryboi"]Would be nice to be alerted when this happens again. Any suggestions how to monitor this behavior?[/QUOTE]
Hi jerryboi, would you like to be alerted about load spike? There are different monitoring tools for that like nagios. :)
But you have to find out the reason for this behaviour. Check your logs when this happens. Look into /opt/zimbra/logs/mailbox.log and /var/log/zimbra.log for activities. Besides check jetty logs and auth logs. Maybe syncing is causing load to spike.
Log Files - Zimbra :: Wiki

[jerryboi]

@theboina: version is 7.1 NE, on Centos5 32bit. (as indicated in my profile)

@fyd: I am setting up nagios as we spe... chat. 10Q for the tip.

[fyd]

[quote user="jerryboi"]@theboina: version is 7.1 NE, on Centos5 32bit. (as indicated in my profile)

@fyd: I am setting up nagios as we spe... chat. 10Q for the tip.[/QUOTE]
Good decision jerryboi!