2015-01-05

Java

2014-12-31 12:23:55,290 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x349cbbeec8e3a79, likely server has closed socket, closing socket connection and attempting reconnect
2014-12-31 12:23:55,290 WARN org.apache.zookeeper.ClientCnxn: Session 0x349cbbeec8e4271 for server node4.etu.im/140.114.60.156:2181, unexpected error, closing socket connection and attempting reconnect
java.lang.OutOfMemoryError: Java heap space
2014-12-31 12:23:55,290 INFO org.apache.zookeeper.ClientCnxn: Client session timed out, have not heard from server in 45749ms for sessionid 0x349cbbeec8e4273, closing socket connection and attempting reconnect
2014-12-31 12:23:55,291 WARN org.apache.zookeeper.ClientCnxn: Session 0x349cbbeec8e426e for server node4.etu.im/140.114.60.156:2181, unexpected error, closing socket connection and attempting reconnect
java.lang.OutOfMemoryError: Java heap space
2014-12-31 12:23:55,291 WARN org.apache.zookeeper.ClientCnxn: Session 0x449cbbef9fb3ba4 for server node5.etu.im/140.114.60.154:2181, unexpected error, closing socket connection and attempting reconnect
java.lang.OutOfMemoryError: Java heap space
        at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:39)
        at java.nio.ByteBuffer.allocate(ByteBuffer.java:312)
        at org.apache.jute.BinaryOutputArchive.<init>(BinaryOutputArchive.java:33)
        at org.apache.jute.BinaryOutputArchive.getArchive(BinaryOutputArchive.java:38)
        at org.apache.zookeeper.ClientCnxn$Packet.createBB(ClientCnxn.java:282)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:115)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
2014-12-31 12:23:55,290 ERROR org.apache.zookeeper.ClientCnxn: from pool-1-thread-268-SendThread(master.etu.im:2181)
java.lang.OutOfMemoryError: Java heap space

[root@master ~]# netstat -nlp | grep 10000
tcp        0      0 0.0.0.0:10000               0.0.0.0:*                   LISTEN      229484/java
[root@master ~]# export PID=$(netstat -nlp | grep 10000 | awk '{ print $7 }' | sed 's#/.*##')
[root@master ~]# jmap -heap $PID
Attaching to process ID 229484, please wait...
Debugger attached successfully.
Server compiler detected.
JVM version is 20.6-b01

using parallel threads in the new generation.
using thread-local object allocation.
Concurrent Mark-Sweep GC

Heap Configuration:
   MinHeapFreeRatio = 40
   MaxHeapFreeRatio = 70
   MaxHeapSize      = 1073741824 (1024.0MB)
   NewSize          = 21757952 (20.75MB)
   MaxNewSize       = 501612544 (478.375MB)
   OldSize          = 65404928 (62.375MB)
   NewRatio         = 7
   SurvivorRatio    = 8
   PermSize         = 21757952 (20.75MB)
   MaxPermSize      = 85983232 (82.0MB)

Heap Usage:
New Generation (Eden + 1 Survivor Space):
   capacity = 120848384 (115.25MB)
   used     = 57228680 (54.57752227783203MB)
   free     = 63619704 (60.67247772216797MB)
   47.35576770310805% used
Eden Space:
   capacity = 107479040 (102.5MB)
   used     = 55967520 (53.374786376953125MB)
   free     = 51511520 (49.125213623046875MB)
   52.07296231897866% used
From Space:
   capacity = 13369344 (12.75MB)
   used     = 1261160 (1.2027359008789062MB)
   free     = 12108184 (11.547264099121094MB)
   9.433222751991421% used
To Space:
   capacity = 13369344 (12.75MB)
   used     = 0 (0.0MB)
   free     = 13369344 (12.75MB)
   0.0% used
concurrent mark-sweep generation:
   capacity = 939524096 (896.0MB)
   used     = 5558840 (5.301322937011719MB)
   free     = 933965256 (890.6986770629883MB)
   0.591665506362915% used
Perm Generation:
   capacity = 29032448 (27.6875MB)
   used     = 28856296 (27.519508361816406MB)
   free     = 176152 (0.16799163818359375MB)
   99.39325819166196% used