crawlzilla/stress_testing: dmesg

File dmesg, 97.8 KB (added by rock, 14 years ago)
Line 
1[    0.000000] Initializing cgroup subsys cpuset
2[    0.000000] Initializing cgroup subsys cpu
3[    0.000000] Linux version 2.6.32-24-generic (buildd@rothera) (gcc version 4.4.3 (Ubuntu 4.4.3-4ubuntu5) ) #39-Ubuntu SMP Wed Jul 28 06:07:29 UTC 2010 (Ubuntu 2.6.32-24.39-generic 2.6.32.15+drm33.5)
4[    0.000000] KERNEL supported cpus:
5[    0.000000]   Intel GenuineIntel
6[    0.000000]   AMD AuthenticAMD
7[    0.000000]   NSC Geode by NSC
8[    0.000000]   Cyrix CyrixInstead
9[    0.000000]   Centaur CentaurHauls
10[    0.000000]   Transmeta GenuineTMx86
11[    0.000000]   Transmeta TransmetaCPU
12[    0.000000]   UMC UMC UMC UMC
13[    0.000000] BIOS-provided physical RAM map:
14[    0.000000]  BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
15[    0.000000]  BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
16[    0.000000]  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
17[    0.000000]  BIOS-e820: 0000000000100000 - 000000001fff0000 (usable)
18[    0.000000]  BIOS-e820: 000000001fff0000 - 0000000020000000 (ACPI data)
19[    0.000000]  BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
20[    0.000000] DMI 2.5 present.
21[    0.000000] last_pfn = 0x1fff0 max_arch_pfn = 0x100000
22[    0.000000] MTRR default type: uncachable
23[    0.000000] MTRR variable ranges disabled:
24[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
25[    0.000000] CPU MTRRs all blank - virtualized system.
26[    0.000000] e820 update range: 0000000000002000 - 0000000000006000 (usable) ==> (reserved)
27[    0.000000] Scanning 1 areas for low memory corruption
28[    0.000000] modified physical RAM map:
29[    0.000000]  modified: 0000000000000000 - 0000000000002000 (usable)
30[    0.000000]  modified: 0000000000002000 - 0000000000006000 (reserved)
31[    0.000000]  modified: 0000000000006000 - 000000000009fc00 (usable)
32[    0.000000]  modified: 000000000009fc00 - 00000000000a0000 (reserved)
33[    0.000000]  modified: 00000000000f0000 - 0000000000100000 (reserved)
34[    0.000000]  modified: 0000000000100000 - 000000001fff0000 (usable)
35[    0.000000]  modified: 000000001fff0000 - 0000000020000000 (ACPI data)
36[    0.000000]  modified: 00000000fffc0000 - 0000000100000000 (reserved)
37[    0.000000] initial memory mapped : 0 - 00c00000
38[    0.000000] init_memory_mapping: 0000000000000000-000000001fff0000
39[    0.000000] Using x86 segment limits to approximate NX protection
40[    0.000000]  0000000000 - 0000400000 page 4k
41[    0.000000]  0000400000 - 001fc00000 page 2M
42[    0.000000]  001fc00000 - 001fff0000 page 4k
43[    0.000000] kernel direct mapping tables up to 1fff0000 @ 7000-c000
44[    0.000000] RAMDISK: 1789a000 - 1803349b
45[    0.000000] ACPI: RSDP 000e0000 00024 (v02 VBOX  )
46[    0.000000] ACPI: XSDT 1fff0030 0002C (v01 VBOX   VBOXXSDT 00000001 ASL  00000061)
47[    0.000000] ACPI: FACP 1fff00e0 000F4 (v04 VBOX   VBOXFACP 00000001 ASL  00000061)
48[    0.000000] ACPI: DSDT 1fff0220 01A0C (v01 VBOX   VBOXBIOS 00000002 INTL 20090521)
49[    0.000000] ACPI: FACS 1fff01e0 00040
50[    0.000000] 0MB HIGHMEM available.
51[    0.000000] 511MB LOWMEM available.
52[    0.000000]   mapped low ram: 0 - 1fff0000
53[    0.000000]   low ram: 0 - 1fff0000
54[    0.000000]   node 0 low ram: 00000000 - 1fff0000
55[    0.000000]   node 0 bootmap 00008000 - 0000c000
56[    0.000000] (9 early reservations) ==> bootmem [0000000000 - 001fff0000]
57[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
58[    0.000000]   #1 [0000001000 - 0000002000]    EX TRAMPOLINE ==> [0000001000 - 0000002000]
59[    0.000000]   #2 [0000006000 - 0000007000]       TRAMPOLINE ==> [0000006000 - 0000007000]
60[    0.000000]   #3 [0000100000 - 00008dbeb8]    TEXT DATA BSS ==> [0000100000 - 00008dbeb8]
61[    0.000000]   #4 [001789a000 - 001803349b]          RAMDISK ==> [001789a000 - 001803349b]
62[    0.000000]   #5 [000009fc00 - 0000100000]    BIOS reserved ==> [000009fc00 - 0000100000]
63[    0.000000]   #6 [00008dc000 - 00008df071]              BRK ==> [00008dc000 - 00008df071]
64[    0.000000]   #7 [0000007000 - 0000008000]          PGTABLE ==> [0000007000 - 0000008000]
65[    0.000000]   #8 [0000008000 - 000000c000]          BOOTMAP ==> [0000008000 - 000000c000]
66[    0.000000] Zone PFN ranges:
67[    0.000000]   DMA      0x00000000 -> 0x00001000
68[    0.000000]   Normal   0x00001000 -> 0x0001fff0
69[    0.000000]   HighMem  0x0001fff0 -> 0x0001fff0
70[    0.000000] Movable zone start PFN for each node
71[    0.000000] early_node_map[3] active PFN ranges
72[    0.000000]     0: 0x00000000 -> 0x00000002
73[    0.000000]     0: 0x00000006 -> 0x0000009f
74[    0.000000]     0: 0x00000100 -> 0x0001fff0
75[    0.000000] On node 0 totalpages: 130955
76[    0.000000] free_area_init_node: node 0, pgdat c0798780, node_mem_map c1001000
77[    0.000000]   DMA zone: 32 pages used for memmap
78[    0.000000]   DMA zone: 0 pages reserved
79[    0.000000]   DMA zone: 3963 pages, LIFO batch:0
80[    0.000000]   Normal zone: 992 pages used for memmap
81[    0.000000]   Normal zone: 125968 pages, LIFO batch:31
82[    0.000000] Using APIC driver default
83[    0.000000] ACPI: PM-Timer IO Port: 0x4008
84[    0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
85[    0.000000] Found and enabled local APIC!
86[    0.000000] nr_irqs_gsi: 16
87[    0.000000] PM: Registered nosave memory: 0000000000002000 - 0000000000006000
88[    0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
89[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
90[    0.000000] PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
91[    0.000000] Allocating PCI resources starting at 20000000 (gap: 20000000:dffc0000)
92[    0.000000] Booting paravirtualized kernel on bare hardware
93[    0.000000] NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:1 nr_node_ids:1
94[    0.000000] PERCPU: Embedded 14 pages/cpu @c1800000 s36056 r0 d21288 u4194304
95[    0.000000] pcpu-alloc: s36056 r0 d21288 u4194304 alloc=1*4194304
96[    0.000000] pcpu-alloc: [0] 0
97[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 129931
98[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-2.6.32-24-generic root=UUID=a9358e02-6653-4f08-b034-43dc0a00ee49 ro quiet splash
99[    0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
100[    0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
101[    0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
102[    0.000000] Enabling fast FPU save and restore... done.
103[    0.000000] Enabling unmasked SIMD FPU exception support... done.
104[    0.000000] Initializing CPU#0
105[    0.000000] allocated 2621120 bytes of page_cgroup
106[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
107[    0.000000] Initializing HighMem for node 0 (00000000:00000000)
108[    0.000000] Memory: 500428k/524224k available (4679k kernel code, 23004k reserved, 2116k data, 660k init, 0k highmem)
109[    0.000000] virtual kernel memory layout:
110[    0.000000]     fixmap  : 0xfff1d000 - 0xfffff000   ( 904 kB)
111[    0.000000]     pkmap   : 0xff800000 - 0xffc00000   (4096 kB)
112[    0.000000]     vmalloc : 0xe07f0000 - 0xff7fe000   ( 496 MB)
113[    0.000000]     lowmem  : 0xc0000000 - 0xdfff0000   ( 511 MB)
114[    0.000000]       .init : 0xc07a3000 - 0xc0848000   ( 660 kB)
115[    0.000000]       .data : 0xc0591d43 - 0xc07a2e88   (2116 kB)
116[    0.000000]       .text : 0xc0100000 - 0xc0591d43   (4679 kB)
117[    0.000000] Checking if this processor honours the WP bit even in supervisor mode...Ok.
118[    0.000000] SLUB: Genslabs=13, HWalign=128, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
119[    0.000000] Hierarchical RCU implementation.
120[    0.000000] NR_IRQS:2304 nr_irqs:256
121[    0.000000] Console: colour VGA+ 80x25
122[    0.000000] console [tty0] enabled
123[    0.000000] Fast TSC calibration failed
124[    0.000000] TSC: Unable to calibrate against PIT
125[    0.000000] TSC: using PMTIMER reference calibration
126[    0.000000] Detected 3363.224 MHz processor.
127[    0.039592] Calibrating delay loop (skipped), value calculated using timer frequency.. 6726.44 BogoMIPS (lpj=13452896)
128[    0.044431] Security Framework initialized
129[    0.045751] AppArmor: AppArmor initialized
130[    0.046080] Mount-cache hash table entries: 512
131[    0.060320] Initializing cgroup subsys ns
132[    0.061331] Initializing cgroup subsys cpuacct
133[    0.061687] Initializing cgroup subsys memory
134[    0.062740] Initializing cgroup subsys devices
135[    0.062894] Initializing cgroup subsys freezer
136[    0.063016] Initializing cgroup subsys net_cls
137[    0.065922] CPU: Trace cache: 12K uops
138[    0.067838] mce: CPU supports 0 MCE banks
139[    0.068294] using mwait in idle threads.
140[    0.068458] Performance Events: no PMU driver, software events only.
141[    0.069050] Checking 'hlt' instruction... OK.
142[    0.169009] SMP alternatives: switching to UP code
143[    0.956002] Freeing SMP alternatives: 19k freed
144[    0.960519] ACPI: Core revision 20090903
145[    0.970867] ACPI: setting ELCR to 0200 (from 0e00)
146[    0.976002] ftrace: converting mcount calls to 0f 1f 44 00 00
147[    0.977098] ftrace: allocating 21780 entries in 43 pages
148[    1.067566] Enabling APIC mode:  Flat.  Using 0 I/O APICs
149[    1.068725] weird, boot CPU (#0) not listed by the BIOS.
150[    1.069052] SMP motherboard not detected.
151[    1.072003] SMP disabled
152[    1.104323] Brought up 1 CPUs
153[    1.104581] Total of 1 processors activated (6726.44 BogoMIPS).
154[    1.110482] CPU0 attaching NULL sched-domain.
155[    1.129500] devtmpfs: initialized
156[    1.142094] regulator: core version 0.5
157[    1.144404] Time:  8:57:37  Date: 09/09/10
158[    1.144940] NET: Registered protocol family 16
159[    1.154689] EISA bus registered
160[    1.156774] ACPI: bus type pci registered
161[    1.165428] PCI: PCI BIOS revision 2.10 entry at 0xfc080, last bus=0
162[    1.165571] PCI: Using configuration type 1 for base access
163[    1.174317] bio: create slab <bio-0> at 0
164[    1.185431] ACPI: EC: Look up EC in DSDT
165[    1.199727] ACPI: Interpreter enabled
166[    1.199858] ACPI: (supports S0 S5)
167[    1.200228] ACPI: Using PIC for interrupt routing
168[    1.206523] ACPI: No dock devices found.
169[    1.216772] ACPI: PCI Root Bridge [PCI0] (0000:00)
170[    1.224003] pci 0000:00:01.1: reg 20 io port: [0xd000-0xd00f]
171[    1.225567] pci 0000:00:02.0: reg 10 32bit mmio pref: [0xe0000000-0xe0ffffff]
172[    1.226354] pci 0000:00:03.0: reg 10 io port: [0xd020-0xd03f]
173[    1.226486] pci 0000:00:03.0: reg 14 32bit mmio: [0xf0000000-0xf0000fff]
174[    1.226627] pci 0000:00:03.0: reg 18 32bit mmio: [0xf0080000-0xf00fffff]
175[    1.228130] pci 0000:00:04.0: reg 10 io port: [0xd040-0xd05f]
176[    1.228276] pci 0000:00:04.0: reg 14 32bit mmio: [0xf0400000-0xf07fffff]
177[    1.228414] pci 0000:00:04.0: reg 18 32bit mmio pref: [0xf0800000-0xf0803fff]
178[    1.229904] pci_bus 0000:00: on NUMA node 0
179[    1.229995] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
180[    1.235525] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 9 10 11) *0, disabled.
181[    1.236257] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 9 10 *11)
182[    1.236621] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 9 *10 11)
183[    1.237157] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 *9 10 11)
184[    1.240003] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
185[    1.244339] vgaarb: loaded
186[    1.246379] SCSI subsystem initialized
187[    1.247334] libata version 3.00 loaded.
188[    1.249297] usbcore: registered new interface driver usbfs
189[    1.249405] usbcore: registered new interface driver hub
190[    1.249844] usbcore: registered new device driver usb
191[    1.267004] ACPI: WMI: Mapper loaded
192[    1.267093] PCI: Using ACPI for IRQ routing
193[    1.268582] NetLabel: Initializing
194[    1.268690] NetLabel:  domain hash size = 128
195[    1.268769] NetLabel:  protocols = UNLABELED CIPSOv4
196[    1.268931] NetLabel:  unlabeled traffic allowed by default
197[    1.278399] Switching to clocksource tsc
198[    1.307893] AppArmor: AppArmor Filesystem Enabled
199[    1.308139] pnp: PnP ACPI init
200[    1.308261] ACPI: bus type pnp registered
201[    1.311718] pnp: PnP ACPI: found 5 devices
202[    1.311779] ACPI: ACPI bus type pnp unregistered
203[    1.311843] PnPBIOS: Disabled by ACPI PNP
204[    1.347870] pci_bus 0000:00: resource 0 io:  [0x00-0xffff]
205[    1.347916] pci_bus 0000:00: resource 1 mem: [0x000000-0xffffffff]
206[    1.348042] NET: Registered protocol family 2
207[    1.352521] IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
208[    1.353293] TCP established hash table entries: 16384 (order: 5, 131072 bytes)
209[    1.353499] TCP bind hash table entries: 16384 (order: 5, 131072 bytes)
210[    1.353701] TCP: Hash tables configured (established 16384 bind 16384)
211[    1.353744] TCP reno registered
212[    1.353943] NET: Registered protocol family 1
213[    1.354050] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
214[    1.354150] pci 0000:00:01.0: Activating ISA DMA hang workarounds
215[    1.354213] pci 0000:00:02.0: Boot video device
216[    1.356520] platform rtc_cmos: registered platform RTC device (no PNP device found)
217[    1.361104] Trying to unpack rootfs image as initramfs...
218[    1.368287] cpufreq-nforce2: No nForce2 chipset.
219[    1.368437] Scanning for low memory corruption every 60 seconds
220[    1.401766] audit: initializing netlink socket (disabled)
221[    1.403873] type=2000 audit(1284022657.400:1): initialized
222[    1.433795] HugeTLB registered 4 MB page size, pre-allocated 0 pages
223[    1.437042] VFS: Disk quotas dquot_6.5.2
224[    1.437169] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
225[    1.438607] fuse init (API version 7.13)
226[    1.438767] msgmni has been set to 978
227[    1.457642] alg: No test for stdrng (krng)
228[    1.458437] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
229[    1.458655] io scheduler noop registered
230[    1.458709] io scheduler anticipatory registered
231[    1.458761] io scheduler deadline registered
232[    1.458894] io scheduler cfq registered (default)
233[    1.459236] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
234[    1.459360] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
235[    1.460953] ACPI: AC Adapter [AC] (on-line)
236[    1.463418] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
237[    1.463500] ACPI: Power Button [PWRF]
238[    1.463711] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1
239[    1.463755] ACPI: Sleep Button [SLPF]
240[    1.498507] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
241[    1.502921] isapnp: Scanning for PnP cards...
242[    1.515089] brd: module loaded
243[    1.515805] loop: module loaded
244[    1.516062] input: Macintosh mouse button emulation as /devices/virtual/input/input2
245[    1.529711] ata_piix 0000:00:01.1: version 2.13
246[    1.613047] scsi0 : ata_piix
247[    1.614018] scsi1 : ata_piix
248[    1.614604] ata1: PATA max UDMA/33 cmd 0x1f0 ctl 0x3f6 bmdma 0xd000 irq 14
249[    1.614660] ata2: PATA max UDMA/33 cmd 0x170 ctl 0x376 bmdma 0xd008 irq 15
250[    1.664932] Fixed MDIO Bus: probed
251[    1.665157] PPP generic driver version 2.4.2
252[    1.665527] tun: Universal TUN/TAP device driver, 1.6
253[    1.665566] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
254[    1.666071] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
255[    1.666169] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
256[    1.666227] uhci_hcd: USB Universal Host Controller Interface driver
257[    1.666825] PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12
258[    1.685288] serio: i8042 KBD port at 0x60,0x64 irq 1
259[    1.685966] serio: i8042 AUX port at 0x60,0x64 irq 12
260[    1.688927] mice: PS/2 mouse device common for all mice
261[    1.698419] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
262[    1.753357] rtc0: alarms up to one day, 114 bytes nvram
263[    1.753854] device-mapper: uevent: version 1.0.3
264[    1.761830] device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) initialised: dm-devel@redhat.com
265[    1.762802] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input3
266[    1.763935] device-mapper: multipath: version 1.1.0 loaded
267[    1.763985] device-mapper: multipath round-robin: version 1.0.0 loaded
268[    1.764636] EISA: Probing bus 0 at eisa.0
269[    1.764701] Cannot allocate resource for EISA slot 4
270[    1.764758] EISA: Detected 0 cards.
271[    1.772565] cpuidle: using governor ladder
272[    1.772619] cpuidle: using governor menu
273[    1.773650] TCP cubic registered
274[    1.773924] NET: Registered protocol family 10
275[    1.774973] lo: Disabled Privacy Extensions
276[    1.775412] NET: Registered protocol family 17
277[    1.791709] Using IPI No-Shortcut mode
278[    1.849073] ata2.00: ATAPI: VBOX CD-ROM, 1.0, max UDMA/133
279[    1.851009] ata2.00: configured for UDMA/33
280[    1.864344] ata1.00: ATA-6: VBOX HARDDISK, 1.0, max UDMA/133
281[    1.864695] ata1.00: 16777216 sectors, multi 128: LBA
282[    1.865998] ata1.00: configured for UDMA/33
283[    1.868027] PM: Resume from disk failed.
284[    1.868200] registered taskstats version 1
285[    1.868753]   Magic number: 10:981:977
286[    1.870644] rtc_cmos rtc_cmos: setting system clock to 2010-09-09 08:57:38 UTC (1284022658)
287[    1.870699] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
288[    1.870736] EDD information not available.
289[    2.207801] Freeing initrd memory: 7781k freed
290[    2.308163] isapnp: No Plug & Play device found
291[    2.368688] scsi 0:0:0:0: Direct-Access     ATA      VBOX HARDDISK    1.0  PQ: 0 ANSI: 5
292[    2.370586] sd 0:0:0:0: [sda] 16777216 512-byte logical blocks: (8.58 GB/8.00 GiB)
293[    2.373242] sd 0:0:0:0: [sda] Write Protect is off
294[    2.373321] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
295[    2.377389] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
296[    2.383782] sd 0:0:0:0: Attached scsi generic sg0 type 0
297[    2.392604] scsi 1:0:0:0: CD-ROM            VBOX     CD-ROM           1.0  PQ: 0 ANSI: 5
298[    2.394101]  sda:sr0: scsi3-mmc drive: 32x/32x xa/form2 tray
299[    2.420860] Uniform CD-ROM driver Revision: 3.20
300[    2.421542] sr 1:0:0:0: Attached scsi CD-ROM sr0
301[    2.421819] sr 1:0:0:0: Attached scsi generic sg1 type 5
302[    2.423991]  sda1 sda2 < sda5 >
303[    2.438173] sd 0:0:0:0: [sda] Attached SCSI disk
304[    2.438342] Freeing unused kernel memory: 660k freed
305[    2.458323] Write protecting the kernel text: 4680k
306[    2.461751] Write protecting the kernel read-only data: 1840k
307[    2.670228] udev: starting version 151
308[    3.581224] pcnet32.c:v1.35 21.Apr.2008 tsbogend@alpha.franken.de
309[    3.613118] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10
310[    3.613211] PCI: setting IRQ 10 as level-triggered
311[    3.613264] pcnet32 0000:00:03.0: PCI INT A -> Link[LNKC] -> GSI 10 (level, low) -> IRQ 10
312[    3.613394] pcnet32: PCnet/FAST III 79C973 at 0xd020, 08:00:27:d2:2d:66 assigned IRQ 10.
313[    3.614229] pcnet32: Found PHY 0022:561b at address 0.
314[    3.635457] eth0: registered as PCnet/FAST III 79C973
315[    3.649762] pcnet32: 1 cards_found.
316[    3.832381] EXT4-fs (sda1): mounted filesystem with ordered data mode
317[   10.032716] Adding 407544k swap on /dev/sda5.  Priority:-1 extents:1 across:407544k
318[   10.195476] udev: starting version 151
319[   10.778201] udev: renamed network interface eth0 to eth1
320[   10.851622] vga16fb: initializing
321[   10.851792] vga16fb: mapped to 0xc00a0000
322[   10.854288] piix4_smbus 0000:00:07.0: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
323[   10.883711] fb0: VGA16 VGA frame buffer device
324[   11.207849] lp: driver loaded but no devices found
325[   11.552663] psmouse serio1: ID: 10 00 64
326[   11.608784] parport_pc 00:04: reported by Plug and Play ACPI
327[   11.789313] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
328[   12.003990] type=1505 audit(1283993868.630:2):  operation="profile_load" pid=318 name="/sbin/dhclient3"
329[   12.123989] type=1505 audit(1283993868.750:3):  operation="profile_load" pid=318 name="/usr/lib/NetworkManager/nm-dhcp-client.action"
330[   12.170091] type=1505 audit(1283993868.798:4):  operation="profile_load" pid=318 name="/usr/lib/connman/scripts/dhclient-script"
331[   13.267299] ppdev: user-space parallel port driver
332[   14.330798] Console: switching to colour frame buffer device 80x30
333[   15.800046] eth1: link up, 100Mbps, full-duplex
334[   16.107426] type=1505 audit(1283993872.734:5):  operation="profile_load" pid=519 name="/usr/share/gdm/guest-session/Xsession"
335[   16.205565] type=1505 audit(1283993872.834:6):  operation="profile_replace" pid=523 name="/sbin/dhclient3"
336[   16.206382] type=1505 audit(1283993872.834:7):  operation="profile_replace" pid=523 name="/usr/lib/NetworkManager/nm-dhcp-client.action"
337[   16.206806] type=1505 audit(1283993872.834:8):  operation="profile_replace" pid=523 name="/usr/lib/connman/scripts/dhclient-script"
338[   16.365106] type=1505 audit(1283993872.994:9):  operation="profile_load" pid=527 name="/usr/bin/evince"
339[   16.421947] type=1505 audit(1283993873.051:10):  operation="profile_load" pid=527 name="/usr/bin/evince-previewer"
340[   16.480238] type=1505 audit(1283993873.110:11):  operation="profile_load" pid=527 name="/usr/bin/evince-thumbnailer"
341[   26.490175] eth1: no IPv6 routers present
342[  172.486566] hrtimer: interrupt took 1804353 ns
343[ 3708.113234] __ratelimit: 9 callbacks suppressed
344[ 3708.113551] counter.sh invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
345[ 3708.113598] counter.sh cpuset=/ mems_allowed=0
346[ 3708.113935] Pid: 11384, comm: counter.sh Not tainted 2.6.32-24-generic #39-Ubuntu
347[ 3708.113976] Call Trace:
348[ 3708.116048]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
349[ 3708.125945]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
350[ 3708.126014]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
351[ 3708.126081]  [<c01cd998>] out_of_memory+0x58/0xb0
352[ 3708.126147]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
353[ 3708.126215]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
354[ 3708.126343]  [<c01e6049>] do_wp_page+0x1b9/0x820
355[ 3708.126424]  [<c013052c>] ? kmap_atomic_prot+0x4c/0xf0
356[ 3708.126491]  [<c01e6e0c>] handle_mm_fault+0x2fc/0x390
357[ 3708.126578]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
358[ 3708.126645]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
359[ 3708.126711]  [<c058d0b3>] error_code+0x73/0x80
360[ 3708.126765] Mem-Info:
361[ 3708.126813] DMA per-cpu:
362[ 3708.126854] CPU    0: hi:    0, btch:   1 usd:   0
363[ 3708.126890] Normal per-cpu:
364[ 3708.126931] CPU    0: hi:  186, btch:  31 usd: 174
365[ 3708.126984] active_anon:57529 inactive_anon:57612 isolated_anon:0
366[ 3708.126996]  active_file:200 inactive_file:223 isolated_file:166
367[ 3708.127007]  unevictable:0 dirty:33 writeback:0 unstable:0
368[ 3708.127018]  free:1271 slab_reclaimable:1854 slab_unreclaimable:2967
369[ 3708.127030]  mapped:257 shmem:65 pagetables:2046 bounce:0
370[ 3708.127092] DMA free:2044kB min:84kB low:104kB high:124kB active_anon:2360kB inactive_anon:2564kB active_file:12kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):24kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:12kB shmem:0kB slab_reclaimable:4kB slab_unreclaimable:680kB kernel_stack:808kB pagetables:12kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:4 all_unreclaimable? no
371[ 3708.127161] lowmem_reserve[]: 0 492 492 492
372[ 3708.127390] Normal free:3040kB min:2792kB low:3488kB high:4188kB active_anon:227756kB inactive_anon:227884kB active_file:788kB inactive_file:860kB unevictable:0kB isolated(anon):0kB isolated(file):640kB present:503872kB mlocked:0kB dirty:132kB writeback:0kB mapped:1016kB shmem:260kB slab_reclaimable:7412kB slab_unreclaimable:11188kB kernel_stack:8056kB pagetables:8172kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:623 all_unreclaimable? no
373[ 3708.127467] lowmem_reserve[]: 0 0 0 0
374[ 3708.127630] DMA: 105*4kB 4*8kB 10*16kB 1*32kB 2*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2052kB
375[ 3708.128349] Normal: 720*4kB 18*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3040kB
376[ 3708.128702] 8881 total pagecache pages
377[ 3708.128743] 8277 pages in swap cache
378[ 3708.128784] Swap cache stats: add 1718191, delete 1709914, find 424523/625995
379[ 3708.128823] Free swap  = 0kB
380[ 3708.128857] Total swap = 407544kB
381[ 3708.133519] 131056 pages RAM
382[ 3708.133569] 0 pages HighMem
383[ 3708.133603] 3737 pages reserved
384[ 3708.133637] 3129 pages shared
385[ 3708.133672] 124113 pages non-shared
386[ 3708.133724] Out of memory: kill process 3843 (go.sh) score 1775788 or a child
387[ 3708.133791] Killed process 4205 (counter.sh)
388[ 3709.200789] counter.sh invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
389[ 3709.200978] counter.sh cpuset=/ mems_allowed=0
390[ 3709.201021] Pid: 11384, comm: counter.sh Not tainted 2.6.32-24-generic #39-Ubuntu
391[ 3709.201061] Call Trace:
392[ 3709.201133]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
393[ 3709.201201]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
394[ 3709.201267]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
395[ 3709.201333]  [<c01cd998>] out_of_memory+0x58/0xb0
396[ 3709.201399]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
397[ 3709.201466]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
398[ 3709.201533]  [<c01e6049>] do_wp_page+0x1b9/0x820
399[ 3709.201600]  [<c013052c>] ? kmap_atomic_prot+0x4c/0xf0
400[ 3709.201666]  [<c01e6e0c>] handle_mm_fault+0x2fc/0x390
401[ 3709.201733]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
402[ 3709.201799]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
403[ 3709.201865]  [<c058d0b3>] error_code+0x73/0x80
404[ 3709.201902] Mem-Info:
405[ 3709.201937] DMA per-cpu:
406[ 3709.201973] CPU    0: hi:    0, btch:   1 usd:   0
407[ 3709.202010] Normal per-cpu:
408[ 3709.202047] CPU    0: hi:  186, btch:  31 usd:  44
409[ 3709.202096] active_anon:57565 inactive_anon:57541 isolated_anon:0
410[ 3709.202107]  active_file:289 inactive_file:607 isolated_file:0
411[ 3709.202119]  unevictable:0 dirty:38 writeback:1 unstable:0
412[ 3709.202130]  free:1210 slab_reclaimable:1854 slab_unreclaimable:2962
413[ 3709.202142]  mapped:330 shmem:65 pagetables:2041 bounce:0
414[ 3709.202197] DMA free:2048kB min:84kB low:104kB high:124kB active_anon:2600kB inactive_anon:2312kB active_file:8kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:4kB slab_unreclaimable:672kB kernel_stack:808kB pagetables:12kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
415[ 3709.202266] lowmem_reserve[]: 0 492 492 492
416[ 3709.202459] Normal free:2792kB min:2792kB low:3488kB high:4188kB active_anon:227660kB inactive_anon:227852kB active_file:1148kB inactive_file:2428kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503872kB mlocked:0kB dirty:152kB writeback:4kB mapped:1316kB shmem:260kB slab_reclaimable:7412kB slab_unreclaimable:11176kB kernel_stack:8056kB pagetables:8152kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:5569 all_unreclaimable? yes
417[ 3709.202532] lowmem_reserve[]: 0 0 0 0
418[ 3709.202733] DMA: 104*4kB 4*8kB 10*16kB 1*32kB 2*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2048kB
419[ 3709.203095] Normal: 668*4kB 13*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2792kB
420[ 3709.203585] 9239 total pagecache pages
421[ 3709.203621] 8278 pages in swap cache
422[ 3709.203648] Swap cache stats: add 1718224, delete 1709946, find 424525/626002
423[ 3709.203965] Free swap  = 0kB
424[ 3709.204005] Total swap = 407544kB
425[ 3709.205613] 131056 pages RAM
426[ 3709.205702] 0 pages HighMem
427[ 3709.205736] 3737 pages reserved
428[ 3709.205771] 3018 pages shared
429[ 3709.205806] 124366 pages non-shared
430[ 3709.205846] Out of memory: kill process 3843 (go.sh) score 1775260 or a child
431[ 3709.205898] Killed process 4531 (java)
432[ 3762.006286] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0
433[ 3762.006592] java cpuset=/ mems_allowed=0
434[ 3762.006640] Pid: 10151, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
435[ 3762.006680] Call Trace:
436[ 3762.006823]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
437[ 3762.006894]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
438[ 3762.006986]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
439[ 3762.007052]  [<c01cd998>] out_of_memory+0x58/0xb0
440[ 3762.007118]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
441[ 3762.007186]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
442[ 3762.007253]  [<c01e33a0>] do_anonymous_page+0x100/0x270
443[ 3762.007325]  [<c013052c>] ? kmap_atomic_prot+0x4c/0xf0
444[ 3762.007392]  [<c01e6e48>] handle_mm_fault+0x338/0x390
445[ 3762.007472]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
446[ 3762.007555]  [<c0354439>] ? copy_to_user+0x39/0x130
447[ 3762.007621]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
448[ 3762.007687]  [<c058d0b3>] error_code+0x73/0x80
449[ 3762.007728] Mem-Info:
450[ 3762.007763] DMA per-cpu:
451[ 3762.007799] CPU    0: hi:    0, btch:   1 usd:   0
452[ 3762.007836] Normal per-cpu:
453[ 3762.007873] CPU    0: hi:  186, btch:  31 usd: 180
454[ 3762.007923] active_anon:57474 inactive_anon:57494 isolated_anon:33
455[ 3762.007934]  active_file:292 inactive_file:368 isolated_file:255
456[ 3762.007946]  unevictable:0 dirty:7 writeback:32 unstable:0
457[ 3762.007957]  free:1231 slab_reclaimable:1849 slab_unreclaimable:2972
458[ 3762.007969]  mapped:392 shmem:59 pagetables:2020 bounce:0
459[ 3762.008201] DMA free:2076kB min:84kB low:104kB high:124kB active_anon:2256kB inactive_anon:2452kB active_file:16kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:4kB slab_unreclaimable:672kB kernel_stack:992kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:30 all_unreclaimable? no
460[ 3762.008289] lowmem_reserve[]: 0 492 492 492
461[ 3762.008469] Normal free:2848kB min:2792kB low:3488kB high:4188kB active_anon:227640kB inactive_anon:227524kB active_file:1152kB inactive_file:1440kB unevictable:0kB isolated(anon):132kB isolated(file):1020kB present:503872kB mlocked:0kB dirty:28kB writeback:128kB mapped:1548kB shmem:236kB slab_reclaimable:7392kB slab_unreclaimable:11216kB kernel_stack:7928kB pagetables:8064kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:576 all_unreclaimable? no
462[ 3762.008542] lowmem_reserve[]: 0 0 0 0
463[ 3762.008706] DMA: 85*4kB 13*8kB 10*16kB 2*32kB 2*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2076kB
464[ 3762.009064] Normal: 698*4kB 7*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2848kB
465[ 3762.009419] 10293 total pagecache pages
466[ 3762.009454] 9372 pages in swap cache
467[ 3762.009492] Swap cache stats: add 1752029, delete 1742657, find 425748/630798
468[ 3762.009531] Free swap  = 0kB
469[ 3762.009565] Total swap = 407544kB
470[ 3762.010954] 131056 pages RAM
471[ 3762.011008] 0 pages HighMem
472[ 3762.011042] 3737 pages reserved
473[ 3762.011077] 3805 pages shared
474[ 3762.011111] 123987 pages non-shared
475[ 3762.011152] Out of memory: kill process 3334 (go.sh) score 1775128 or a child
476[ 3762.011195] Killed process 3551 (counter.sh)
477[ 3795.666698] cron invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
478[ 3795.666956] cron cpuset=/ mems_allowed=0
479[ 3795.667005] Pid: 11465, comm: cron Not tainted 2.6.32-24-generic #39-Ubuntu
480[ 3795.667044] Call Trace:
481[ 3795.667138]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
482[ 3795.667205]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
483[ 3795.667272]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
484[ 3795.667337]  [<c01cd998>] out_of_memory+0x58/0xb0
485[ 3795.667403]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
486[ 3795.667511]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
487[ 3795.667614]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
488[ 3795.667687]  [<c01d2af6>] ra_submit+0x26/0x30
489[ 3795.667753]  [<c01ccaec>] filemap_fault+0x3dc/0x410
490[ 3795.667824]  [<c0154610>] ? do_proc_dointvec_conv+0x0/0x50
491[ 3795.667891]  [<c01e5040>] __do_fault+0x40/0x490
492[ 3795.667957]  [<c01e6c49>] handle_mm_fault+0x139/0x390
493[ 3795.668225]  [<c07c4008>] ? sel_netport_init+0x1a/0x78
494[ 3795.668306]  [<c07c4008>] ? sel_netport_init+0x1a/0x78
495[ 3795.668382]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
496[ 3795.668448]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
497[ 3795.668514]  [<c058d0b3>] error_code+0x73/0x80
498[ 3795.668555] Mem-Info:
499[ 3795.668589] DMA per-cpu:
500[ 3795.668626] CPU    0: hi:    0, btch:   1 usd:   0
501[ 3795.668662] Normal per-cpu:
502[ 3795.668699] CPU    0: hi:  186, btch:  31 usd: 174
503[ 3795.668748] active_anon:57465 inactive_anon:57545 isolated_anon:0
504[ 3795.668760]  active_file:286 inactive_file:335 isolated_file:160
505[ 3795.668771]  unevictable:0 dirty:34 writeback:39 unstable:0
506[ 3795.668783]  free:1292 slab_reclaimable:1846 slab_unreclaimable:2992
507[ 3795.668794]  mapped:402 shmem:59 pagetables:2051 bounce:0
508[ 3795.668850] DMA free:2072kB min:84kB low:104kB high:124kB active_anon:2268kB inactive_anon:2336kB active_file:16kB inactive_file:48kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:16kB shmem:0kB slab_reclaimable:4kB slab_unreclaimable:680kB kernel_stack:1088kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:16 all_unreclaimable? no
509[ 3795.668920] lowmem_reserve[]: 0 492 492 492
510[ 3795.669105] Normal free:3096kB min:2792kB low:3488kB high:4188kB active_anon:227592kB inactive_anon:227844kB active_file:1128kB inactive_file:1292kB unevictable:0kB isolated(anon):0kB isolated(file):640kB present:503872kB mlocked:0kB dirty:136kB writeback:156kB mapped:1592kB shmem:236kB slab_reclaimable:7380kB slab_unreclaimable:11288kB kernel_stack:7912kB pagetables:8188kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:96 all_unreclaimable? no
511[ 3795.669178] lowmem_reserve[]: 0 0 0 0
512[ 3795.669337] DMA: 84*4kB 11*8kB 11*16kB 2*32kB 2*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2072kB
513[ 3795.669698] Normal: 764*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3096kB
514[ 3795.670055] 9728 total pagecache pages
515[ 3795.670090] 8892 pages in swap cache
516[ 3795.670128] Swap cache stats: add 1766076, delete 1757184, find 426148/632913
517[ 3795.670167] Free swap  = 0kB
518[ 3795.670201] Total swap = 407544kB
519[ 3795.671439] 131056 pages RAM
520[ 3795.671554] 0 pages HighMem
521[ 3795.671588] 3737 pages reserved
522[ 3795.671623] 5880 pages shared
523[ 3795.671658] 121829 pages non-shared
524[ 3795.671698] Out of memory: kill process 2973 (go.sh) score 1774888 or a child
525[ 3795.671741] Killed process 3099 (counter.sh)
526[ 3795.745134] Xorg invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
527[ 3795.745545] Xorg cpuset=/ mems_allowed=0
528[ 3795.745593] Pid: 1209, comm: Xorg Not tainted 2.6.32-24-generic #39-Ubuntu
529[ 3795.745632] Call Trace:
530[ 3795.745704]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
531[ 3795.745786]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
532[ 3795.745853]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
533[ 3795.745918]  [<c01cd998>] out_of_memory+0x58/0xb0
534[ 3795.745984]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
535[ 3795.746051]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
536[ 3795.746118]  [<c01cc91d>] filemap_fault+0x20d/0x410
537[ 3795.746185]  [<c01e5040>] __do_fault+0x40/0x490
538[ 3795.746250]  [<c01e6c49>] handle_mm_fault+0x139/0x390
539[ 3795.746318]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
540[ 3795.746384]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
541[ 3795.746450]  [<c058d0b3>] error_code+0x73/0x80
542[ 3795.746487] Mem-Info:
543[ 3795.746521] DMA per-cpu:
544[ 3795.746557] CPU    0: hi:    0, btch:   1 usd:   0
545[ 3795.746594] Normal per-cpu:
546[ 3795.746630] CPU    0: hi:  186, btch:  31 usd:  64
547[ 3795.746685] active_anon:57442 inactive_anon:57503 isolated_anon:32
548[ 3795.746691]  active_file:325 inactive_file:581 isolated_file:96
549[ 3795.746708]  unevictable:0 dirty:34 writeback:19 unstable:0
550[ 3795.746720]  free:1255 slab_reclaimable:1846 slab_unreclaimable:2992
551[ 3795.746732]  mapped:382 shmem:59 pagetables:2041 bounce:0
552[ 3795.746945] DMA free:2048kB min:84kB low:104kB high:124kB active_anon:2268kB inactive_anon:2336kB active_file:16kB inactive_file:48kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:16kB shmem:0kB slab_reclaimable:4kB slab_unreclaimable:680kB kernel_stack:1088kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
553[ 3795.747017] lowmem_reserve[]: 0 492 492 492
554[ 3795.747198] Normal free:2972kB min:2792kB low:3488kB high:4188kB active_anon:227500kB inactive_anon:227676kB active_file:1284kB inactive_file:2276kB unevictable:0kB isolated(anon):128kB isolated(file):384kB present:503872kB mlocked:0kB dirty:136kB writeback:76kB mapped:1512kB shmem:236kB slab_reclaimable:7380kB slab_unreclaimable:11288kB kernel_stack:7912kB pagetables:8148kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:128 all_unreclaimable? no
555[ 3795.747270] lowmem_reserve[]: 0 0 0 0
556[ 3795.747568] DMA: 78*4kB 11*8kB 11*16kB 2*32kB 2*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2048kB
557[ 3795.747931] Normal: 727*4kB 8*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2972kB
558[ 3795.755267] 9972 total pagecache pages
559[ 3795.755304] 8906 pages in swap cache
560[ 3795.755341] Swap cache stats: add 1766107, delete 1757201, find 426148/632914
561[ 3795.755380] Free swap  = 0kB
562[ 3795.755415] Total swap = 407544kB
563[ 3795.755992] 131056 pages RAM
564[ 3795.758358] 0 pages HighMem
565[ 3795.758404] 3737 pages reserved
566[ 3795.758440] 5710 pages shared
567[ 3795.758475] 121976 pages non-shared
568[ 3795.758516] Out of memory: kill process 3334 (go.sh) score 1774600 or a child
569[ 3795.758559] Killed process 3857 (java)
570[ 3795.901877] firefox-bin invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
571[ 3795.902137] firefox-bin cpuset=/ mems_allowed=0
572[ 3795.902181] Pid: 1551, comm: firefox-bin Not tainted 2.6.32-24-generic #39-Ubuntu
573[ 3795.902221] Call Trace:
574[ 3795.902293]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
575[ 3795.902361]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
576[ 3795.902428]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
577[ 3795.902494]  [<c01cd998>] out_of_memory+0x58/0xb0
578[ 3795.902560]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
579[ 3795.902627]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
580[ 3795.902694]  [<c01cc91d>] filemap_fault+0x20d/0x410
581[ 3795.902761]  [<c01e5040>] __do_fault+0x40/0x490
582[ 3795.902827]  [<c01e6c49>] handle_mm_fault+0x139/0x390
583[ 3795.902895]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
584[ 3795.902980]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
585[ 3795.903046]  [<c058d0b3>] error_code+0x73/0x80
586[ 3795.903083] Mem-Info:
587[ 3795.903118] DMA per-cpu:
588[ 3795.903154] CPU    0: hi:    0, btch:   1 usd:   0
589[ 3795.903191] Normal per-cpu:
590[ 3795.903362] CPU    0: hi:  186, btch:  31 usd:  77
591[ 3795.903412] active_anon:57481 inactive_anon:57502 isolated_anon:0
592[ 3795.903424]  active_file:395 inactive_file:581 isolated_file:32
593[ 3795.903436]  unevictable:0 dirty:14 writeback:0 unstable:0
594[ 3795.903447]  free:1239 slab_reclaimable:1846 slab_unreclaimable:2989
595[ 3795.903459]  mapped:396 shmem:59 pagetables:2041 bounce:0
596[ 3795.903516] DMA free:2044kB min:84kB low:104kB high:124kB active_anon:2268kB inactive_anon:2336kB active_file:32kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:32kB shmem:0kB slab_reclaimable:4kB slab_unreclaimable:696kB kernel_stack:1088kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:176 all_unreclaimable? no
597[ 3795.903594] lowmem_reserve[]: 0 492 492 492
598[ 3795.903777] Normal free:2912kB min:2792kB low:3488kB high:4188kB active_anon:227656kB inactive_anon:227672kB active_file:1548kB inactive_file:2292kB unevictable:0kB isolated(anon):0kB isolated(file):128kB present:503872kB mlocked:0kB dirty:56kB writeback:0kB mapped:1552kB shmem:236kB slab_reclaimable:7380kB slab_unreclaimable:11260kB kernel_stack:7856kB pagetables:8148kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
599[ 3795.903851] lowmem_reserve[]: 0 0 0 0
600[ 3795.904221] DMA: 82*4kB 9*8kB 11*16kB 2*32kB 2*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2048kB
601[ 3795.904586] Normal: 720*4kB 6*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2928kB
602[ 3795.904947] 9968 total pagecache pages
603[ 3795.904984] 8899 pages in swap cache
604[ 3795.905022] Swap cache stats: add 1766161, delete 1757262, find 426150/632922
605[ 3795.905062] Free swap  = 8kB
606[ 3795.905097] Total swap = 407544kB
607[ 3795.906378] 131056 pages RAM
608[ 3795.906474] 0 pages HighMem
609[ 3795.906509] 3737 pages reserved
610[ 3795.906545] 5635 pages shared
611[ 3795.906580] 122051 pages non-shared
612[ 3795.906621] Out of memory: kill process 2973 (go.sh) score 1774360 or a child
613[ 3795.906666] Killed process 3210 (java)
614[ 5490.277938] munin-graph invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
615[ 5490.278260] munin-graph cpuset=/ mems_allowed=0
616[ 5490.278309] Pid: 24537, comm: munin-graph Not tainted 2.6.32-24-generic #39-Ubuntu
617[ 5490.278349] Call Trace:
618[ 5490.278442]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
619[ 5490.278611]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
620[ 5490.278678]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
621[ 5490.278744]  [<c01cd998>] out_of_memory+0x58/0xb0
622[ 5490.278809]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
623[ 5490.278876]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
624[ 5490.278944]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
625[ 5490.279011]  [<c01d2af6>] ra_submit+0x26/0x30
626[ 5490.279076]  [<c01ccaec>] filemap_fault+0x3dc/0x410
627[ 5490.279142]  [<c01e5040>] __do_fault+0x40/0x490
628[ 5490.279208]  [<c01e6c49>] handle_mm_fault+0x139/0x390
629[ 5490.279284]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
630[ 5490.279376]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
631[ 5490.279442]  [<c058d0b3>] error_code+0x73/0x80
632[ 5490.279483] Mem-Info:
633[ 5490.279517] DMA per-cpu:
634[ 5490.279568] CPU    0: hi:    0, btch:   1 usd:   0
635[ 5490.279604] Normal per-cpu:
636[ 5490.279641] CPU    0: hi:  186, btch:  31 usd:  66
637[ 5490.279690] active_anon:56494 inactive_anon:56593 isolated_anon:32
638[ 5490.279702]  active_file:264 inactive_file:611 isolated_file:32
639[ 5490.279713]  unevictable:0 dirty:21 writeback:0 unstable:0
640[ 5490.279724]  free:1198 slab_reclaimable:2011 slab_unreclaimable:3579
641[ 5490.279736]  mapped:263 shmem:140 pagetables:1932 bounce:0
642[ 5490.279793] DMA free:2044kB min:84kB low:104kB high:124kB active_anon:1812kB inactive_anon:1996kB active_file:16kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:8kB slab_reclaimable:12kB slab_unreclaimable:1740kB kernel_stack:768kB pagetables:12kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:27 all_unreclaimable? no
643[ 5490.279862] lowmem_reserve[]: 0 492 492 492
644[ 5490.283217] Normal free:2748kB min:2792kB low:3488kB high:4188kB active_anon:224164kB inactive_anon:224376kB active_file:1040kB inactive_file:2412kB unevictable:0kB isolated(anon):128kB isolated(file):128kB present:503872kB mlocked:0kB dirty:84kB writeback:0kB mapped:1032kB shmem:552kB slab_reclaimable:8032kB slab_unreclaimable:12576kB kernel_stack:13728kB pagetables:7716kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:5313 all_unreclaimable? yes
645[ 5490.283339] lowmem_reserve[]: 0 0 0 0
646[ 5490.283511] DMA: 35*4kB 84*8kB 11*16kB 1*32kB 0*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2044kB
647[ 5490.283875] Normal: 649*4kB 17*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2748kB
648[ 5490.287825] 9564 total pagecache pages
649[ 5490.287862] 8531 pages in swap cache
650[ 5490.287885] Swap cache stats: add 2847356, delete 2838825, find 557919/904748
651[ 5490.299194] Free swap  = 0kB
652[ 5490.299194] Total swap = 407544kB
653[ 5490.307689] 131056 pages RAM
654[ 5490.307740] 0 pages HighMem
655[ 5490.307774] 3737 pages reserved
656[ 5490.307808] 5232 pages shared
657[ 5490.307842] 122080 pages non-shared
658[ 5490.307881] Out of memory: kill process 1547 (run-mozilla.sh) score 409338 or a child
659[ 5490.307924] Killed process 1551 (firefox-bin)
660[ 5865.832835] java invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
661[ 5865.833044] java cpuset=/ mems_allowed=0
662[ 5865.833092] Pid: 18365, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
663[ 5865.833131] Call Trace:
664[ 5865.833229]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
665[ 5865.833296]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
666[ 5865.833363]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
667[ 5865.833428]  [<c01cd998>] out_of_memory+0x58/0xb0
668[ 5865.833494]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
669[ 5865.833561]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
670[ 5865.833628]  [<c01f1796>] read_swap_cache_async+0xa6/0xf0
671[ 5865.833694]  [<c01f1847>] swapin_readahead+0x67/0x90
672[ 5865.833760]  [<c01e677d>] do_swap_page+0xcd/0x460
673[ 5865.833826]  [<c01e6ddc>] handle_mm_fault+0x2cc/0x390
674[ 5865.833902]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
675[ 5865.833974]  [<c0354439>] ? copy_to_user+0x39/0x130
676[ 5865.834039]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
677[ 5865.834105]  [<c058d0b3>] error_code+0x73/0x80
678[ 5865.834149] Mem-Info:
679[ 5865.834184] DMA per-cpu:
680[ 5865.834220] CPU    0: hi:    0, btch:   1 usd:   0
681[ 5865.834257] Normal per-cpu:
682[ 5865.834294] CPU    0: hi:  186, btch:  31 usd:  85
683[ 5865.834343] active_anon:56578 inactive_anon:56573 isolated_anon:192
684[ 5865.834355]  active_file:159 inactive_file:206 isolated_file:160
685[ 5865.834366]  unevictable:0 dirty:24 writeback:144 unstable:0
686[ 5865.834377]  free:1192 slab_reclaimable:2021 slab_unreclaimable:3648
687[ 5865.834389]  mapped:194 shmem:170 pagetables:1782 bounce:0
688[ 5865.834445] DMA free:2044kB min:84kB low:104kB high:124kB active_anon:1660kB inactive_anon:1856kB active_file:28kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:12kB writeback:0kB mapped:56kB shmem:0kB slab_reclaimable:12kB slab_unreclaimable:1860kB kernel_stack:1040kB pagetables:28kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:109 all_unreclaimable? no
689[ 5865.834515] lowmem_reserve[]: 0 492 492 492
690[ 5865.834696] Normal free:2724kB min:2792kB low:3488kB high:4188kB active_anon:224652kB inactive_anon:224436kB active_file:608kB inactive_file:808kB unevictable:0kB isolated(anon):768kB isolated(file):640kB present:503872kB mlocked:0kB dirty:84kB writeback:576kB mapped:720kB shmem:680kB slab_reclaimable:8072kB slab_unreclaimable:12732kB kernel_stack:13728kB pagetables:7100kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:880 all_unreclaimable? no
691[ 5865.834769] lowmem_reserve[]: 0 0 0 0
692[ 5865.834935] DMA: 41*4kB 69*8kB 17*16kB 1*32kB 0*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2044kB
693[ 5865.835293] Normal: 675*4kB 3*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2724kB
694[ 5865.835647] 15894 total pagecache pages
695[ 5865.835683] 15230 pages in swap cache
696[ 5865.835721] Swap cache stats: add 3082426, delete 3067196, find 571159/947853
697[ 5865.835760] Free swap  = 0kB
698[ 5865.835795] Total swap = 407544kB
699[ 5865.837644] 131056 pages RAM
700[ 5865.837738] 0 pages HighMem
701[ 5865.837780] 3737 pages reserved
702[ 5865.837823] 2286 pages shared
703[ 5865.837865] 123207 pages non-shared
704[ 5865.837913] Out of memory: kill process 944 (apache2) score 119205 or a child
705[ 5865.837976] Killed process 946 (apache2)
706[ 6586.163311] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
707[ 6586.163589] java cpuset=/ mems_allowed=0
708[ 6586.163642] Pid: 27219, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
709[ 6586.163681] Call Trace:
710[ 6586.163775]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
711[ 6586.163861]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
712[ 6586.163928]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
713[ 6586.163997]  [<c01cd998>] out_of_memory+0x58/0xb0
714[ 6586.171997]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
715[ 6586.172067]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
716[ 6586.172135]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
717[ 6586.172287]  [<c01d2af6>] ra_submit+0x26/0x30
718[ 6586.172353]  [<c01d2c63>] ondemand_readahead+0x83/0x1d0
719[ 6586.172419]  [<c01ca89e>] ? __lock_page+0x7e/0x90
720[ 6586.172485]  [<c01d2e9f>] page_cache_sync_readahead+0x3f/0x70
721[ 6586.172552]  [<c01ccb13>] filemap_fault+0x403/0x410
722[ 6586.172618]  [<c01e5040>] __do_fault+0x40/0x490
723[ 6586.172684]  [<c01e6c49>] handle_mm_fault+0x139/0x390
724[ 6586.172762]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
725[ 6586.172880]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
726[ 6586.172946]  [<c058d0b3>] error_code+0x73/0x80
727[ 6586.172988] Mem-Info:
728[ 6586.173023] DMA per-cpu:
729[ 6586.173059] CPU    0: hi:    0, btch:   1 usd:   0
730[ 6586.173096] Normal per-cpu:
731[ 6586.173133] CPU    0: hi:  186, btch:  31 usd:  72
732[ 6586.173181] active_anon:56482 inactive_anon:56578 isolated_anon:0
733[ 6586.173193]  active_file:129 inactive_file:298 isolated_file:0
734[ 6586.173204]  unevictable:0 dirty:0 writeback:0 unstable:0
735[ 6586.173215]  free:1210 slab_reclaimable:2071 slab_unreclaimable:3784
736[ 6586.173227]  mapped:131 shmem:17 pagetables:1894 bounce:0
737[ 6586.173283] DMA free:2052kB min:84kB low:104kB high:124kB active_anon:624kB inactive_anon:884kB active_file:0kB inactive_file:28kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:28kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:2124kB kernel_stack:2752kB pagetables:24kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
738[ 6586.173352] lowmem_reserve[]: 0 492 492 492
739[ 6586.173546] Normal free:2788kB min:2792kB low:3488kB high:4188kB active_anon:225304kB inactive_anon:225428kB active_file:516kB inactive_file:1164kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503872kB mlocked:0kB dirty:0kB writeback:0kB mapped:496kB shmem:68kB slab_reclaimable:8276kB slab_unreclaimable:13012kB kernel_stack:12936kB pagetables:7552kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3449 all_unreclaimable? yes
740[ 6586.173618] lowmem_reserve[]: 0 0 0 0
741[ 6586.173782] DMA: 65*4kB 65*8kB 14*16kB 1*32kB 0*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2060kB
742[ 6586.174142] Normal: 655*4kB 15*8kB 3*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2788kB
743[ 6586.174498] 10124 total pagecache pages
744[ 6586.174534] 9671 pages in swap cache
745[ 6586.174572] Swap cache stats: add 3726451, delete 3716780, find 608307/1065900
746[ 6586.174611] Free swap  = 0kB
747[ 6586.174645] Total swap = 407544kB
748[ 6586.176829] 131056 pages RAM
749[ 6586.176879] 0 pages HighMem
750[ 6586.176915] 3737 pages reserved
751[ 6586.176953] 9007 pages shared
752[ 6586.176988] 119368 pages non-shared
753[ 6586.177029] Out of memory: kill process 944 (apache2) score 119206 or a child
754[ 6586.177072] Killed process 951 (apache2)
755[ 6586.222809] munin-graph invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
756[ 6586.223164] munin-graph cpuset=/ mems_allowed=0
757[ 6586.223208] Pid: 26654, comm: munin-graph Not tainted 2.6.32-24-generic #39-Ubuntu
758[ 6586.223248] Call Trace:
759[ 6586.223320]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
760[ 6586.223387]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
761[ 6586.223453]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
762[ 6586.223532]  [<c01cd998>] out_of_memory+0x58/0xb0
763[ 6586.223597]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
764[ 6586.223665]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
765[ 6586.223732]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
766[ 6586.223831]  [<c01d2af6>] ra_submit+0x26/0x30
767[ 6586.223896]  [<c01ccaec>] filemap_fault+0x3dc/0x410
768[ 6586.223963]  [<c01e5040>] __do_fault+0x40/0x490
769[ 6586.224216]  [<c03502f4>] ? rb_erase+0xb4/0x120
770[ 6586.224282]  [<c01e6c49>] handle_mm_fault+0x139/0x390
771[ 6586.224349]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
772[ 6586.224415]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
773[ 6586.224481]  [<c058d0b3>] error_code+0x73/0x80
774[ 6586.224518] Mem-Info:
775[ 6586.224552] DMA per-cpu:
776[ 6586.224588] CPU    0: hi:    0, btch:   1 usd:   0
777[ 6586.224625] Normal per-cpu:
778[ 6586.224661] CPU    0: hi:  186, btch:  31 usd:  70
779[ 6586.224812] active_anon:56577 inactive_anon:56569 isolated_anon:0
780[ 6586.224824]  active_file:148 inactive_file:232 isolated_file:0
781[ 6586.224836]  unevictable:0 dirty:0 writeback:0 unstable:0
782[ 6586.224847]  free:1193 slab_reclaimable:2071 slab_unreclaimable:3784
783[ 6586.224858]  mapped:143 shmem:17 pagetables:1894 bounce:0
784[ 6586.224915] DMA free:2052kB min:84kB low:104kB high:124kB active_anon:804kB inactive_anon:680kB active_file:0kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:2124kB kernel_stack:2752kB pagetables:24kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? yes
785[ 6586.224985] lowmem_reserve[]: 0 492 492 492
786[ 6586.225163] Normal free:2720kB min:2792kB low:3488kB high:4188kB active_anon:225504kB inactive_anon:225596kB active_file:592kB inactive_file:896kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503872kB mlocked:0kB dirty:0kB writeback:0kB mapped:576kB shmem:68kB slab_reclaimable:8276kB slab_unreclaimable:13012kB kernel_stack:12880kB pagetables:7552kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
787[ 6586.225235] lowmem_reserve[]: 0 0 0 0
788[ 6586.225393] DMA: 63*4kB 64*8kB 14*16kB 1*32kB 0*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2044kB
789[ 6586.225755] Normal: 638*4kB 13*8kB 5*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2736kB
790[ 6586.226109] 10144 total pagecache pages
791[ 6586.226145] 9744 pages in swap cache
792[ 6586.226182] Swap cache stats: add 3726565, delete 3716821, find 608308/1065925
793[ 6586.226221] Free swap  = 20kB
794[ 6586.226256] Total swap = 407544kB
795[ 6586.227546] 131056 pages RAM
796[ 6586.227639] 0 pages HighMem
797[ 6586.227674] 3737 pages reserved
798[ 6586.227746] 8992 pages shared
799[ 6586.227781] 119378 pages non-shared
800[ 6586.227821] Out of memory: kill process 27219 (java) score 106064 or a child
801[ 6586.227864] Killed process 27219 (java)
802[ 6588.495455] munin-graph invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
803[ 6588.495794] munin-graph cpuset=/ mems_allowed=0
804[ 6588.495847] Pid: 26654, comm: munin-graph Not tainted 2.6.32-24-generic #39-Ubuntu
805[ 6588.495887] Call Trace:
806[ 6588.495981]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
807[ 6588.496608]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
808[ 6588.496675]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
809[ 6588.496740]  [<c01cd998>] out_of_memory+0x58/0xb0
810[ 6588.496806]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
811[ 6588.496873]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
812[ 6588.496939]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
813[ 6588.497006]  [<c01d2af6>] ra_submit+0x26/0x30
814[ 6588.497071]  [<c01ccaec>] filemap_fault+0x3dc/0x410
815[ 6588.497137]  [<c01e5040>] __do_fault+0x40/0x490
816[ 6588.497210]  [<c03502f4>] ? rb_erase+0xb4/0x120
817[ 6588.497275]  [<c01e6c49>] handle_mm_fault+0x139/0x390
818[ 6588.497352]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
819[ 6588.497417]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
820[ 6588.497487]  [<c058d0b3>] error_code+0x73/0x80
821[ 6588.497529] Mem-Info:
822[ 6588.497567] DMA per-cpu:
823[ 6588.497604] CPU    0: hi:    0, btch:   1 usd:   0
824[ 6588.497640] Normal per-cpu:
825[ 6588.497677] CPU    0: hi:  186, btch:  31 usd: 181
826[ 6588.497726] active_anon:56506 inactive_anon:56604 isolated_anon:32
827[ 6588.497738]  active_file:93 inactive_file:201 isolated_file:0
828[ 6588.497749]  unevictable:0 dirty:6 writeback:0 unstable:0
829[ 6588.497760]  free:1202 slab_reclaimable:2066 slab_unreclaimable:3786
830[ 6588.497772]  mapped:136 shmem:17 pagetables:1839 bounce:0
831[ 6588.497828] DMA free:2052kB min:84kB low:104kB high:124kB active_anon:556kB inactive_anon:744kB active_file:16kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:32kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:2132kB kernel_stack:2752kB pagetables:24kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:209 all_unreclaimable? yes
832[ 6588.497897] lowmem_reserve[]: 0 492 492 492
833[ 6588.498076] Normal free:2756kB min:2792kB low:3488kB high:4188kB active_anon:225468kB inactive_anon:225672kB active_file:356kB inactive_file:788kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:503872kB mlocked:0kB dirty:24kB writeback:0kB mapped:512kB shmem:68kB slab_reclaimable:8256kB slab_unreclaimable:13012kB kernel_stack:12720kB pagetables:7332kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2688 all_unreclaimable? yes
834[ 6588.498148] lowmem_reserve[]: 0 0 0 0
835[ 6588.498310] DMA: 37*4kB 74*8kB 14*16kB 2*32kB 0*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2052kB
836[ 6588.498671] Normal: 689*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2756kB
837[ 6588.499023] 10309 total pagecache pages
838[ 6588.499059] 9998 pages in swap cache
839[ 6588.499097] Swap cache stats: add 3727794, delete 3717796, find 608332/1066082
840[ 6588.499135] Free swap  = 0kB
841[ 6588.499170] Total swap = 407544kB
842[ 6588.501376] 131056 pages RAM
843[ 6588.501447] 0 pages HighMem
844[ 6588.501482] 3737 pages reserved
845[ 6588.501516] 6003 pages shared
846[ 6588.501551] 122079 pages non-shared
847[ 6588.501591] Out of memory: kill process 24057 (java) score 90821 or a child
848[ 6588.501634] Killed process 24057 (java)
849[ 6593.933934] munin-graph invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
850[ 6593.934040] munin-graph cpuset=/ mems_allowed=0
851[ 6593.934092] Pid: 26654, comm: munin-graph Not tainted 2.6.32-24-generic #39-Ubuntu
852[ 6593.934132] Call Trace:
853[ 6593.934233]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
854[ 6593.934301]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
855[ 6593.934384]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
856[ 6593.934449]  [<c01cd998>] out_of_memory+0x58/0xb0
857[ 6593.934515]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
858[ 6593.934582]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
859[ 6593.934650]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
860[ 6593.934717]  [<c01d2af6>] ra_submit+0x26/0x30
861[ 6593.934782]  [<c01ccaec>] filemap_fault+0x3dc/0x410
862[ 6593.934848]  [<c01e5040>] __do_fault+0x40/0x490
863[ 6593.934920]  [<c03502f4>] ? rb_erase+0xb4/0x120
864[ 6593.934985]  [<c01e6c49>] handle_mm_fault+0x139/0x390
865[ 6593.935062]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
866[ 6593.935128]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
867[ 6593.935193]  [<c058d0b3>] error_code+0x73/0x80
868[ 6593.935234] Mem-Info:
869[ 6593.935273] DMA per-cpu:
870[ 6593.935309] CPU    0: hi:    0, btch:   1 usd:   0
871[ 6593.935346] Normal per-cpu:
872[ 6593.935383] CPU    0: hi:  186, btch:  31 usd:  32
873[ 6593.935431] active_anon:56544 inactive_anon:56640 isolated_anon:0
874[ 6593.935443]  active_file:12 inactive_file:549 isolated_file:0
875[ 6593.935454]  unevictable:0 dirty:0 writeback:0 unstable:0
876[ 6593.935465]  free:1002 slab_reclaimable:2065 slab_unreclaimable:3787
877[ 6593.935477]  mapped:67 shmem:17 pagetables:1839 bounce:0
878[ 6593.935537] DMA free:2024kB min:84kB low:104kB high:124kB active_anon:536kB inactive_anon:708kB active_file:4kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:2132kB kernel_stack:2720kB pagetables:24kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:115 all_unreclaimable? yes
879[ 6593.935607] lowmem_reserve[]: 0 492 492 492
880[ 6593.935785] Normal free:1984kB min:2792kB low:3488kB high:4188kB active_anon:225640kB inactive_anon:225852kB active_file:44kB inactive_file:2196kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503872kB mlocked:0kB dirty:0kB writeback:0kB mapped:264kB shmem:68kB slab_reclaimable:8252kB slab_unreclaimable:13016kB kernel_stack:12624kB pagetables:7332kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:680 all_unreclaimable? yes
881[ 6593.935857] lowmem_reserve[]: 0 0 0 0
882[ 6593.936886] DMA: 36*4kB 69*8kB 15*16kB 2*32kB 0*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2024kB
883[ 6593.937283] Normal: 496*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1984kB
884[ 6593.937636] 10609 total pagecache pages
885[ 6593.937672] 10031 pages in swap cache
886[ 6593.937709] Swap cache stats: add 3727907, delete 3717876, find 608337/1066100
887[ 6593.937749] Free swap  = 40kB
888[ 6593.937783] Total swap = 407544kB
889[ 6593.939106] 131056 pages RAM
890[ 6593.939196] 0 pages HighMem
891[ 6593.939230] 3737 pages reserved
892[ 6593.939265] 5180 pages shared
893[ 6593.939300] 122544 pages non-shared
894[ 6593.939340] Out of memory: kill process 27116 (java) score 89419 or a child
895[ 6593.939383] Killed process 27116 (java)
896[ 7013.571295] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
897[ 7013.571647] java cpuset=/ mems_allowed=0
898[ 7013.571703] Pid: 26086, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
899[ 7013.571750] Call Trace:
900[ 7013.571853]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
901[ 7013.571929]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
902[ 7013.571986]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
903[ 7013.579961]  [<c01cd998>] out_of_memory+0x58/0xb0
904[ 7013.580029]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
905[ 7013.580097]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
906[ 7013.580151]  [<c01cc91d>] filemap_fault+0x20d/0x410
907[ 7013.580395]  [<c01e5040>] __do_fault+0x40/0x490
908[ 7013.580469]  [<c016ad50>] ? hrtimer_wakeup+0x0/0x30
909[ 7013.580535]  [<c01e6c49>] handle_mm_fault+0x139/0x390
910[ 7013.580612]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
911[ 7013.580678]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
912[ 7013.580743]  [<c058d0b3>] error_code+0x73/0x80
913[ 7013.580784] Mem-Info:
914[ 7013.580819] DMA per-cpu:
915[ 7013.580855] CPU    0: hi:    0, btch:   1 usd:   0
916[ 7013.580892] Normal per-cpu:
917[ 7013.580929] CPU    0: hi:  186, btch:  31 usd:  64
918[ 7013.580978] active_anon:56014 inactive_anon:56101 isolated_anon:480
919[ 7013.580990]  active_file:135 inactive_file:410 isolated_file:64
920[ 7013.581002]  unevictable:0 dirty:4 writeback:15 unstable:0
921[ 7013.581013]  free:1385 slab_reclaimable:2058 slab_unreclaimable:3863
922[ 7013.581024]  mapped:132 shmem:17 pagetables:1861 bounce:0
923[ 7013.581080] DMA free:2064kB min:84kB low:104kB high:124kB active_anon:1196kB inactive_anon:1364kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:4kB writeback:16kB mapped:0kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:2032kB kernel_stack:1872kB pagetables:12kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
924[ 7013.581149] lowmem_reserve[]: 0 492 492 492
925[ 7013.581330] Normal free:3476kB min:2792kB low:3488kB high:4188kB active_anon:222860kB inactive_anon:223040kB active_file:540kB inactive_file:1640kB unevictable:0kB isolated(anon):1920kB isolated(file):256kB present:503872kB mlocked:0kB dirty:12kB writeback:44kB mapped:528kB shmem:68kB slab_reclaimable:8224kB slab_unreclaimable:13420kB kernel_stack:14248kB pagetables:7432kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:237266 all_unreclaimable? no
926[ 7013.581409] lowmem_reserve[]: 0 0 0 0
927[ 7013.581567] DMA: 44*4kB 46*8kB 15*16kB 4*32kB 2*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2064kB
928[ 7013.581931] Normal: 819*4kB 25*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3476kB
929[ 7013.582311] 11275 total pagecache pages
930[ 7013.582346] 10652 pages in swap cache
931[ 7013.582384] Swap cache stats: add 3987554, delete 3976902, find 635825/1127251
932[ 7013.582423] Free swap  = 0kB
933[ 7013.582457] Total swap = 407544kB
934[ 7013.583725] 131056 pages RAM
935[ 7013.583817] 0 pages HighMem
936[ 7013.583851] 3737 pages reserved
937[ 7013.583886] 4640 pages shared
938[ 7013.583921] 121513 pages non-shared
939[ 7013.583961] Out of memory: kill process 944 (apache2) score 119178 or a child
940[ 7013.583989] Killed process 952 (apache2)
941[ 7022.242340] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
942[ 7022.242684] java cpuset=/ mems_allowed=0
943[ 7022.242729] Pid: 26086, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
944[ 7022.242769] Call Trace:
945[ 7022.242844]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
946[ 7022.242914]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
947[ 7022.242982]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
948[ 7022.243050]  [<c01cd998>] out_of_memory+0x58/0xb0
949[ 7022.243117]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
950[ 7022.243187]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
951[ 7022.243255]  [<c01cc91d>] filemap_fault+0x20d/0x410
952[ 7022.243324]  [<c01e5040>] __do_fault+0x40/0x490
953[ 7022.243392]  [<c016ad50>] ? hrtimer_wakeup+0x0/0x30
954[ 7022.243460]  [<c01e6c49>] handle_mm_fault+0x139/0x390
955[ 7022.243529]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
956[ 7022.243597]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
957[ 7022.243665]  [<c058d0b3>] error_code+0x73/0x80
958[ 7022.243703] Mem-Info:
959[ 7022.243739] DMA per-cpu:
960[ 7022.243776] CPU    0: hi:    0, btch:   1 usd:   0
961[ 7022.243814] Normal per-cpu:
962[ 7022.243852] CPU    0: hi:  186, btch:  31 usd:  61
963[ 7022.243903] active_anon:56479 inactive_anon:56521 isolated_anon:114
964[ 7022.243915]  active_file:54 inactive_file:256 isolated_file:46
965[ 7022.243927]  unevictable:0 dirty:3 writeback:39 unstable:0
966[ 7022.243938]  free:1087 slab_reclaimable:2057 slab_unreclaimable:3864
967[ 7022.243950]  mapped:58 shmem:17 pagetables:1861 bounce:0
968[ 7022.243989] DMA free:2048kB min:84kB low:104kB high:124kB active_anon:1072kB inactive_anon:1080kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:2020kB kernel_stack:1872kB pagetables:12kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? yes
969[ 7022.249834] lowmem_reserve[]: 0 492 492 492
970[ 7022.250029] Normal free:2300kB min:2792kB low:3488kB high:4188kB active_anon:224844kB inactive_anon:225004kB active_file:216kB inactive_file:1024kB unevictable:0kB isolated(anon):328kB isolated(file):184kB present:503872kB mlocked:0kB dirty:12kB writeback:156kB mapped:232kB shmem:68kB slab_reclaimable:8220kB slab_unreclaimable:13436kB kernel_stack:14208kB pagetables:7432kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:177614 all_unreclaimable? yes
971[ 7022.250105] lowmem_reserve[]: 0 0 0 0
972[ 7022.250137] DMA: 24*4kB 50*8kB 15*16kB 5*32kB 2*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2048kB
973[ 7022.250137] Normal: 575*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2300kB
974[ 7022.250785] 11424 total pagecache pages
975[ 7022.250820] 11068 pages in swap cache
976[ 7022.250857] Swap cache stats: add 3988355, delete 3977287, find 635835/1127355
977[ 7022.250894] Free swap  = 0kB
978[ 7022.250934] Total swap = 407544kB
979[ 7022.252545] 131056 pages RAM
980[ 7022.252586] 0 pages HighMem
981[ 7022.252620] 3737 pages reserved
982[ 7022.252654] 3790 pages shared
983[ 7022.252688] 122304 pages non-shared
984[ 7022.252728] Out of memory: kill process 944 (apache2) score 105947 or a child
985[ 7022.252771] Killed process 966 (apache2)
986[ 7028.903152] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
987[ 7028.903447] java cpuset=/ mems_allowed=0
988[ 7028.903498] Pid: 25712, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
989[ 7028.903535] Call Trace:
990[ 7028.903624]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
991[ 7028.903689]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
992[ 7028.903753]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
993[ 7028.903816]  [<c01cd998>] out_of_memory+0x58/0xb0
994[ 7028.903958]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
995[ 7028.906998]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
996[ 7028.907068]  [<c01cc91d>] filemap_fault+0x20d/0x410
997[ 7028.907132]  [<c01e5040>] __do_fault+0x40/0x490
998[ 7028.907209]  [<c016ad50>] ? hrtimer_wakeup+0x0/0x30
999[ 7028.907272]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1000[ 7028.907346]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1001[ 7028.907409]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1002[ 7028.907472]  [<c058d0b3>] error_code+0x73/0x80
1003[ 7028.907512] Mem-Info:
1004[ 7028.907545] DMA per-cpu:
1005[ 7028.907581] CPU    0: hi:    0, btch:   1 usd:   0
1006[ 7028.907616] Normal per-cpu:
1007[ 7028.907651] CPU    0: hi:  186, btch:  31 usd: 107
1008[ 7028.907698] active_anon:56216 inactive_anon:56182 isolated_anon:559
1009[ 7028.907709]  active_file:88 inactive_file:249 isolated_file:33
1010[ 7028.907720]  unevictable:0 dirty:0 writeback:10 unstable:0
1011[ 7028.907731]  free:1199 slab_reclaimable:2057 slab_unreclaimable:3866
1012[ 7028.907742]  mapped:88 shmem:17 pagetables:1861 bounce:0
1013[ 7028.907796] DMA free:2048kB min:84kB low:104kB high:124kB active_anon:1180kB inactive_anon:1024kB active_file:4kB inactive_file:0kB unevictable:0kB isolated(anon):128kB isolated(file):64kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:40kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:2020kB kernel_stack:1880kB pagetables:12kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1014[ 7028.907863] lowmem_reserve[]: 0 492 492 492
1015[ 7028.911294] Normal free:2748kB min:2792kB low:3488kB high:4188kB active_anon:223684kB inactive_anon:223704kB active_file:348kB inactive_file:996kB unevictable:0kB isolated(anon):2108kB isolated(file):68kB present:503872kB mlocked:0kB dirty:0kB writeback:0kB mapped:312kB shmem:68kB slab_reclaimable:8220kB slab_unreclaimable:13444kB kernel_stack:14112kB pagetables:7432kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:4016 all_unreclaimable? no
1016[ 7028.911370] lowmem_reserve[]: 0 0 0 0
1017[ 7028.911535] DMA: 24*4kB 52*8kB 14*16kB 5*32kB 2*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2048kB
1018[ 7028.911893] Normal: 589*4kB 47*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2748kB
1019[ 7028.915229] 11125 total pagecache pages
1020[ 7028.915265] 10754 pages in swap cache
1021[ 7028.915307] Swap cache stats: add 3989161, delete 3978407, find 635846/1127421
1022[ 7028.915346] Free swap  = 0kB
1023[ 7028.915380] Total swap = 407544kB
1024[ 7028.915989] 131056 pages RAM
1025[ 7028.923800] 0 pages HighMem
1026[ 7028.923845] 3737 pages reserved
1027[ 7028.923880] 3876 pages shared
1028[ 7028.923915] 121781 pages non-shared
1029[ 7028.923956] Out of memory: kill process 27464 (java) score 90615 or a child
1030[ 7028.923998] Killed process 27464 (java)
1031[ 7030.956338] munin-graph invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1032[ 7030.956524] munin-graph cpuset=/ mems_allowed=0
1033[ 7030.956573] Pid: 28354, comm: munin-graph Not tainted 2.6.32-24-generic #39-Ubuntu
1034[ 7030.956613] Call Trace:
1035[ 7030.956710]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
1036[ 7030.956777]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
1037[ 7030.956848]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
1038[ 7030.956914]  [<c01cd998>] out_of_memory+0x58/0xb0
1039[ 7030.956980]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
1040[ 7030.957047]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
1041[ 7030.957115]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
1042[ 7030.957182]  [<c01d2af6>] ra_submit+0x26/0x30
1043[ 7030.957260]  [<c01ccaec>] filemap_fault+0x3dc/0x410
1044[ 7030.957327]  [<c01e5040>] __do_fault+0x40/0x490
1045[ 7030.957392]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1046[ 7030.957469]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1047[ 7030.957535]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1048[ 7030.957601]  [<c058d0b3>] error_code+0x73/0x80
1049[ 7030.957645] Mem-Info:
1050[ 7030.957680] DMA per-cpu:
1051[ 7030.957716] CPU    0: hi:    0, btch:   1 usd:   0
1052[ 7030.957753] Normal per-cpu:
1053[ 7030.957789] CPU    0: hi:  186, btch:  31 usd:  27
1054[ 7030.957838] active_anon:53973 inactive_anon:55616 isolated_anon:112
1055[ 7030.957851]  active_file:286 inactive_file:3352 isolated_file:49
1056[ 7030.957862]  unevictable:0 dirty:20 writeback:1 unstable:0
1057[ 7030.957873]  free:1387 slab_reclaimable:2057 slab_unreclaimable:3873
1058[ 7030.957885]  mapped:858 shmem:17 pagetables:1811 bounce:0
1059[ 7030.957941] DMA free:2072kB min:84kB low:104kB high:124kB active_anon:832kB inactive_anon:1196kB active_file:80kB inactive_file:416kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:264kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:2028kB kernel_stack:1880kB pagetables:12kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1060[ 7030.958010] lowmem_reserve[]: 0 492 492 492
1061[ 7030.958209] Normal free:3476kB min:2792kB low:3488kB high:4188kB active_anon:215060kB inactive_anon:221268kB active_file:1064kB inactive_file:12992kB unevictable:0kB isolated(anon):448kB isolated(file):196kB present:503872kB mlocked:0kB dirty:80kB writeback:8kB mapped:3168kB shmem:68kB slab_reclaimable:8220kB slab_unreclaimable:13464kB kernel_stack:13928kB pagetables:7232kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:160 all_unreclaimable? no
1062[ 7030.958282] lowmem_reserve[]: 0 0 0 0
1063[ 7030.958441] DMA: 24*4kB 45*8kB 19*16kB 5*32kB 2*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2072kB
1064[ 7030.958801] Normal: 869*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3476kB
1065[ 7030.959156] 14616 total pagecache pages
1066[ 7030.959192] 10935 pages in swap cache
1067[ 7030.959242] Swap cache stats: add 3991772, delete 3980837, find 635866/1127617
1068[ 7030.959282] Free swap  = 3580kB
1069[ 7030.959316] Total swap = 407544kB
1070[ 7030.960846] 131056 pages RAM
1071[ 7030.960915] 0 pages HighMem
1072[ 7030.960949] 3737 pages reserved
1073[ 7030.960984] 5679 pages shared
1074[ 7030.961018] 121065 pages non-shared
1075[ 7030.961059] Out of memory: kill process 1360 (gnome-session) score 84188 or a child
1076[ 7030.961113] Killed process 1391 (ibus-daemon)
1077[ 7286.165404] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1078[ 7286.165598] java cpuset=/ mems_allowed=0
1079[ 7286.165646] Pid: 28630, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
1080[ 7286.165686] Call Trace:
1081[ 7286.165782]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
1082[ 7286.165850]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
1083[ 7286.165916]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
1084[ 7286.165982]  [<c01cd998>] out_of_memory+0x58/0xb0
1085[ 7286.166048]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
1086[ 7286.166128]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
1087[ 7286.166196]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
1088[ 7286.166263]  [<c01d2af6>] ra_submit+0x26/0x30
1089[ 7286.166328]  [<c01ccaec>] filemap_fault+0x3dc/0x410
1090[ 7286.166394]  [<c01e5040>] __do_fault+0x40/0x490
1091[ 7286.166459]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1092[ 7286.166536]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1093[ 7286.166607]  [<c0354439>] ? copy_to_user+0x39/0x130
1094[ 7286.166676]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1095[ 7286.166742]  [<c058d0b3>] error_code+0x73/0x80
1096[ 7286.166787] Mem-Info:
1097[ 7286.166821] DMA per-cpu:
1098[ 7286.166857] CPU    0: hi:    0, btch:   1 usd:   0
1099[ 7286.166894] Normal per-cpu:
1100[ 7286.166931] CPU    0: hi:  186, btch:  31 usd: 177
1101[ 7286.166980] active_anon:56704 inactive_anon:56726 isolated_anon:38
1102[ 7286.166992]  active_file:25 inactive_file:20 isolated_file:0
1103[ 7286.167003]  unevictable:0 dirty:1 writeback:0 unstable:0
1104[ 7286.167014]  free:1194 slab_reclaimable:1854 slab_unreclaimable:3907
1105[ 7286.167026]  mapped:38 shmem:8 pagetables:1607 bounce:0
1106[ 7286.167081] DMA free:2052kB min:84kB low:104kB high:124kB active_anon:1728kB inactive_anon:1804kB active_file:24kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:16kB slab_unreclaimable:2036kB kernel_stack:848kB pagetables:20kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1107[ 7286.167151] lowmem_reserve[]: 0 492 492 492
1108[ 7286.167330] Normal free:2724kB min:2792kB low:3488kB high:4188kB active_anon:225088kB inactive_anon:225100kB active_file:76kB inactive_file:48kB unevictable:0kB isolated(anon):152kB isolated(file):0kB present:503872kB mlocked:0kB dirty:8kB writeback:0kB mapped:132kB shmem:32kB slab_reclaimable:7400kB slab_unreclaimable:13592kB kernel_stack:16192kB pagetables:6408kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:332 all_unreclaimable? no
1109[ 7286.167402] lowmem_reserve[]: 0 0 0 0
1110[ 7286.167575] DMA: 37*4kB 66*8kB 4*16kB 1*32kB 2*64kB 7*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2052kB
1111[ 7286.167933] Normal: 681*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2724kB
1112[ 7286.168461] 18040 total pagecache pages
1113[ 7286.168497] 17986 pages in swap cache
1114[ 7286.168534] Swap cache stats: add 4398303, delete 4380317, find 693553/1241433
1115[ 7286.168573] Free swap  = 0kB
1116[ 7286.168608] Total swap = 407544kB
1117[ 7286.169932] 131056 pages RAM
1118[ 7286.170004] 0 pages HighMem
1119[ 7286.170057] 3737 pages reserved
1120[ 7286.170092] 505 pages shared
1121[ 7286.170126] 123708 pages non-shared
1122[ 7286.170166] Out of memory: kill process 28612 (java) score 90852 or a child
1123[ 7286.170219] Killed process 28612 (java)
1124[ 7940.201148] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1125[ 7940.201476] java cpuset=/ mems_allowed=0
1126[ 7940.201526] Pid: 30958, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
1127[ 7940.201564] Call Trace:
1128[ 7940.201660]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
1129[ 7940.201725]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
1130[ 7940.201789]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
1131[ 7940.201852]  [<c01cd998>] out_of_memory+0x58/0xb0
1132[ 7940.201915]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
1133[ 7940.201980]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
1134[ 7940.202045]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
1135[ 7940.202110]  [<c01d2af6>] ra_submit+0x26/0x30
1136[ 7940.202173]  [<c01ccaec>] filemap_fault+0x3dc/0x410
1137[ 7940.202263]  [<c01e5040>] __do_fault+0x40/0x490
1138[ 7940.202327]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1139[ 7940.202400]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1140[ 7940.202464]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1141[ 7940.202527]  [<c058d0b3>] error_code+0x73/0x80
1142[ 7940.202567] Mem-Info:
1143[ 7940.202604] DMA per-cpu:
1144[ 7940.202639] CPU    0: hi:    0, btch:   1 usd:   0
1145[ 7940.202675] Normal per-cpu:
1146[ 7940.202710] CPU    0: hi:  186, btch:  31 usd:  28
1147[ 7940.202757] active_anon:55955 inactive_anon:55946 isolated_anon:32
1148[ 7940.202769]  active_file:157 inactive_file:329 isolated_file:32
1149[ 7940.202780]  unevictable:0 dirty:25 writeback:0 unstable:0
1150[ 7940.202791]  free:1281 slab_reclaimable:2214 slab_unreclaimable:4117
1151[ 7940.202802]  mapped:224 shmem:10 pagetables:1750 bounce:0
1152[ 7940.202860] DMA free:2072kB min:84kB low:104kB high:124kB active_anon:984kB inactive_anon:964kB active_file:16kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:24kB slab_unreclaimable:2416kB kernel_stack:2008kB pagetables:36kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
1153[ 7940.202934] lowmem_reserve[]: 0 492 492 492
1154[ 7940.203108] Normal free:3052kB min:2792kB low:3488kB high:4188kB active_anon:222836kB inactive_anon:222820kB active_file:612kB inactive_file:1300kB unevictable:0kB isolated(anon):128kB isolated(file):128kB present:503872kB mlocked:0kB dirty:100kB writeback:0kB mapped:876kB shmem:40kB slab_reclaimable:8832kB slab_unreclaimable:14052kB kernel_stack:16368kB pagetables:6964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
1155[ 7940.203177] lowmem_reserve[]: 0 0 0 0
1156[ 7940.203334] DMA: 40*4kB 91*8kB 10*16kB 0*32kB 0*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2072kB
1157[ 7940.203679] Normal: 731*4kB 14*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3052kB
1158[ 7940.204149] 11612 total pagecache pages
1159[ 7940.204196] 11085 pages in swap cache
1160[ 7940.204245] Swap cache stats: add 5301614, delete 5290529, find 732613/1389914
1161[ 7940.204283] Free swap  = 0kB
1162[ 7940.204316] Total swap = 407544kB
1163[ 7940.205516] 131056 pages RAM
1164[ 7940.205588] 0 pages HighMem
1165[ 7940.205621] 3737 pages reserved
1166[ 7940.205654] 7178 pages shared
1167[ 7940.205688] 122411 pages non-shared
1168[ 7940.205727] Out of memory: kill process 944 (apache2) score 119149 or a child
1169[ 7940.205769] Killed process 25152 (apache2)
1170[ 8114.310904] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1171[ 8114.311152] java cpuset=/ mems_allowed=0
1172[ 8114.311200] Pid: 31172, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
1173[ 8114.311239] Call Trace:
1174[ 8114.311336]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
1175[ 8114.311418]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
1176[ 8114.311485]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
1177[ 8114.311551]  [<c01cd998>] out_of_memory+0x58/0xb0
1178[ 8114.311637]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
1179[ 8114.311704]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
1180[ 8114.311772]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
1181[ 8114.311839]  [<c01d2af6>] ra_submit+0x26/0x30
1182[ 8114.311905]  [<c01ccaec>] filemap_fault+0x3dc/0x410
1183[ 8114.311971]  [<c01e5040>] __do_fault+0x40/0x490
1184[ 8114.312227]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1185[ 8114.312306]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1186[ 8114.312372]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1187[ 8114.312438]  [<c058d0b3>] error_code+0x73/0x80
1188[ 8114.312483] Mem-Info:
1189[ 8114.312518] DMA per-cpu:
1190[ 8114.312554] CPU    0: hi:    0, btch:   1 usd:   0
1191[ 8114.312591] Normal per-cpu:
1192[ 8114.312628] CPU    0: hi:  186, btch:  31 usd: 164
1193[ 8114.312677] active_anon:57034 inactive_anon:57145 isolated_anon:0
1194[ 8114.312689]  active_file:214 inactive_file:264 isolated_file:0
1195[ 8114.312700]  unevictable:0 dirty:28 writeback:0 unstable:0
1196[ 8114.312711]  free:1254 slab_reclaimable:2121 slab_unreclaimable:3652
1197[ 8114.312723]  mapped:212 shmem:11 pagetables:1782 bounce:0
1198[ 8114.312779] DMA free:2064kB min:84kB low:104kB high:124kB active_anon:1196kB inactive_anon:1432kB active_file:16kB inactive_file:48kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:8kB shmem:0kB slab_reclaimable:24kB slab_unreclaimable:2168kB kernel_stack:1536kB pagetables:48kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1199[ 8114.312870] lowmem_reserve[]: 0 492 492 492
1200[ 8114.313056] Normal free:2952kB min:2792kB low:3488kB high:4188kB active_anon:226940kB inactive_anon:227148kB active_file:840kB inactive_file:1008kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503872kB mlocked:0kB dirty:112kB writeback:0kB mapped:840kB shmem:44kB slab_reclaimable:8460kB slab_unreclaimable:12440kB kernel_stack:9664kB pagetables:7080kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1201[ 8114.313134] lowmem_reserve[]: 0 0 0 0
1202[ 8114.313398] DMA: 20*4kB 38*8kB 13*16kB 12*32kB 1*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2064kB
1203[ 8114.313759] Normal: 726*4kB 6*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2952kB
1204[ 8114.314116] 8177 total pagecache pages
1205[ 8114.314152] 7679 pages in swap cache
1206[ 8114.314190] Swap cache stats: add 5457971, delete 5450292, find 741351/1416743
1207[ 8114.314229] Free swap  = 0kB
1208[ 8114.314263] Total swap = 407544kB
1209[ 8114.315867] 131056 pages RAM
1210[ 8114.315925] 0 pages HighMem
1211[ 8114.315959] 3737 pages reserved
1212[ 8114.315991] 9734 pages shared
1213[ 8114.322210] 118586 pages non-shared
1214[ 8114.322263] Out of memory: kill process 944 (apache2) score 119178 or a child
1215[ 8114.322317] Killed process 27879 (apache2)
1216[ 8117.938161] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1217[ 8117.938377] java cpuset=/ mems_allowed=0
1218[ 8117.938427] Pid: 31170, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
1219[ 8117.938465] Call Trace:
1220[ 8117.938629]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
1221[ 8117.938695]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
1222[ 8117.938773]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
1223[ 8117.938838]  [<c01cd998>] out_of_memory+0x58/0xb0
1224[ 8117.938902]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
1225[ 8117.939031]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
1226[ 8117.939097]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
1227[ 8117.939162]  [<c01d2af6>] ra_submit+0x26/0x30
1228[ 8117.939225]  [<c01ccaec>] filemap_fault+0x3dc/0x410
1229[ 8117.939289]  [<c01e5040>] __do_fault+0x40/0x490
1230[ 8117.939352]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1231[ 8117.939426]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1232[ 8117.940221]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1233[ 8117.940287]  [<c058d0b3>] error_code+0x73/0x80
1234[ 8117.940328] Mem-Info:
1235[ 8117.940366] DMA per-cpu:
1236[ 8117.940403] CPU    0: hi:    0, btch:   1 usd:   0
1237[ 8117.940439] Normal per-cpu:
1238[ 8117.940476] CPU    0: hi:  186, btch:  31 usd: 177
1239[ 8117.940525] active_anon:56975 inactive_anon:57098 isolated_anon:3
1240[ 8117.940537]  active_file:239 inactive_file:208 isolated_file:125
1241[ 8117.940549]  unevictable:0 dirty:30 writeback:3 unstable:0
1242[ 8117.940560]  free:1348 slab_reclaimable:2117 slab_unreclaimable:3639
1243[ 8117.940572]  mapped:391 shmem:11 pagetables:1727 bounce:0
1244[ 8117.940632] DMA free:2052kB min:84kB low:104kB high:124kB active_anon:1200kB inactive_anon:1392kB active_file:12kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:28kB shmem:0kB slab_reclaimable:24kB slab_unreclaimable:2168kB kernel_stack:1536kB pagetables:48kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1245[ 8117.940702] lowmem_reserve[]: 0 492 492 492
1246[ 8117.940882] Normal free:3340kB min:2792kB low:3488kB high:4188kB active_anon:226700kB inactive_anon:227000kB active_file:944kB inactive_file:816kB unevictable:0kB isolated(anon):12kB isolated(file):500kB present:503872kB mlocked:0kB dirty:120kB writeback:12kB mapped:1536kB shmem:44kB slab_reclaimable:8444kB slab_unreclaimable:12388kB kernel_stack:9448kB pagetables:6860kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
1247[ 8117.940954] lowmem_reserve[]: 0 0 0 0
1248[ 8117.941116] DMA: 15*4kB 40*8kB 13*16kB 12*32kB 1*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2060kB
1249[ 8117.941474] Normal: 813*4kB 11*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3340kB
1250[ 8117.941828] 8388 total pagecache pages
1251[ 8117.941863] 7827 pages in swap cache
1252[ 8117.941901] Swap cache stats: add 5459727, delete 5451900, find 741398/1416982
1253[ 8117.941944] Free swap  = 0kB
1254[ 8117.941979] Total swap = 407544kB
1255[ 8117.943256] 131056 pages RAM
1256[ 8117.943333] 0 pages HighMem
1257[ 8117.943367] 3737 pages reserved
1258[ 8117.943402] 6415 pages shared
1259[ 8117.943497] 121977 pages non-shared
1260[ 8117.943537] Out of memory: kill process 31147 (java) score 90346 or a child
1261[ 8117.943581] Killed process 31147 (java)
1262[ 8320.073037] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1263[ 8320.073273] java cpuset=/ mems_allowed=0
1264[ 8320.073325] Pid: 32075, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
1265[ 8320.073364] Call Trace:
1266[ 8320.073427]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
1267[ 8320.073898]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
1268[ 8320.073965]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
1269[ 8320.074031]  [<c01cd998>] out_of_memory+0x58/0xb0
1270[ 8320.074097]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
1271[ 8320.074164]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
1272[ 8320.074231]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
1273[ 8320.074298]  [<c01d2af6>] ra_submit+0x26/0x30
1274[ 8320.074363]  [<c01ccaec>] filemap_fault+0x3dc/0x410
1275[ 8320.074429]  [<c01e5040>] __do_fault+0x40/0x490
1276[ 8320.074505]  [<c059121c>] ? smp_apic_timer_interrupt+0x5c/0x8b
1277[ 8320.074572]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1278[ 8320.074638]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1279[ 8320.074704]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1280[ 8320.074769]  [<c058d0b3>] error_code+0x73/0x80
1281[ 8320.074810] Mem-Info:
1282[ 8320.074849] DMA per-cpu:
1283[ 8320.074885] CPU    0: hi:    0, btch:   1 usd:   0
1284[ 8320.074922] Normal per-cpu:
1285[ 8320.074959] CPU    0: hi:  186, btch:  31 usd: 181
1286[ 8320.075008] active_anon:56395 inactive_anon:56481 isolated_anon:32
1287[ 8320.075020]  active_file:179 inactive_file:188 isolated_file:192
1288[ 8320.075031]  unevictable:0 dirty:29 writeback:0 unstable:0
1289[ 8320.075042]  free:1302 slab_reclaimable:2111 slab_unreclaimable:3738
1290[ 8320.075054]  mapped:343 shmem:259 pagetables:1809 bounce:0
1291[ 8320.075115] DMA free:2080kB min:84kB low:104kB high:124kB active_anon:876kB inactive_anon:1072kB active_file:32kB inactive_file:52kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:8kB writeback:0kB mapped:36kB shmem:4kB slab_reclaimable:24kB slab_unreclaimable:2296kB kernel_stack:2056kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1292[ 8320.075185] lowmem_reserve[]: 0 492 492 492
1293[ 8320.075364] Normal free:3128kB min:2792kB low:3488kB high:4188kB active_anon:224704kB inactive_anon:224852kB active_file:684kB inactive_file:700kB unevictable:0kB isolated(anon):128kB isolated(file):768kB present:503872kB mlocked:0kB dirty:108kB writeback:0kB mapped:1336kB shmem:1032kB slab_reclaimable:8420kB slab_unreclaimable:12656kB kernel_stack:13224kB pagetables:7220kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:208 all_unreclaimable? no
1294[ 8320.075437] lowmem_reserve[]: 0 0 0 0
1295[ 8320.075599] DMA: 26*4kB 50*8kB 14*16kB 8*32kB 1*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2072kB
1296[ 8320.075992] Normal: 770*4kB 4*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3128kB
1297[ 8320.076499] 11242 total pagecache pages
1298[ 8320.076534] 10422 pages in swap cache
1299[ 8320.076572] Swap cache stats: add 5703494, delete 5693072, find 761047/1467063
1300[ 8320.076611] Free swap  = 4kB
1301[ 8320.076646] Total swap = 407544kB
1302[ 8320.078107] 131056 pages RAM
1303[ 8320.078193] 0 pages HighMem
1304[ 8320.078228] 3737 pages reserved
1305[ 8320.078262] 5513 pages shared
1306[ 8320.078297] 121479 pages non-shared
1307[ 8320.078338] Out of memory: kill process 32212 (java) score 89610 or a child
1308[ 8320.078382] Killed process 32212 (java)
1309[ 8325.004897] munin-graph invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1310[ 8325.005096] munin-graph cpuset=/ mems_allowed=0
1311[ 8325.005140] Pid: 32117, comm: munin-graph Not tainted 2.6.32-24-generic #39-Ubuntu
1312[ 8325.005186] Call Trace:
1313[ 8325.005258]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
1314[ 8325.005340]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
1315[ 8325.005407]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
1316[ 8325.005472]  [<c01cd998>] out_of_memory+0x58/0xb0
1317[ 8325.005538]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
1318[ 8325.005605]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
1319[ 8325.005673]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
1320[ 8325.005740]  [<c01d2af6>] ra_submit+0x26/0x30
1321[ 8325.005805]  [<c01ccaec>] filemap_fault+0x3dc/0x410
1322[ 8325.005871]  [<c01e5040>] __do_fault+0x40/0x490
1323[ 8325.005937]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1324[ 8325.006005]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1325[ 8325.006071]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1326[ 8325.006136]  [<c058d0b3>] error_code+0x73/0x80
1327[ 8325.006173] Mem-Info:
1328[ 8325.006208] DMA per-cpu:
1329[ 8325.006244] CPU    0: hi:    0, btch:   1 usd:   0
1330[ 8325.006280] Normal per-cpu:
1331[ 8325.006317] CPU    0: hi:  186, btch:  31 usd: 158
1332[ 8325.006366] active_anon:56344 inactive_anon:56420 isolated_anon:0
1333[ 8325.006378]  active_file:432 inactive_file:454 isolated_file:0
1334[ 8325.006389]  unevictable:0 dirty:2 writeback:12 unstable:0
1335[ 8325.006400]  free:1214 slab_reclaimable:2108 slab_unreclaimable:3732
1336[ 8325.006412]  mapped:474 shmem:248 pagetables:1795 bounce:0
1337[ 8325.006468] DMA free:2044kB min:84kB low:104kB high:124kB active_anon:836kB inactive_anon:1016kB active_file:52kB inactive_file:164kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:0kB writeback:0kB mapped:48kB shmem:4kB slab_reclaimable:24kB slab_unreclaimable:2296kB kernel_stack:2072kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1338[ 8325.006537] lowmem_reserve[]: 0 492 492 492
1339[ 8325.006717] Normal free:2812kB min:2792kB low:3488kB high:4188kB active_anon:224540kB inactive_anon:224664kB active_file:1676kB inactive_file:1652kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503872kB mlocked:0kB dirty:8kB writeback:48kB mapped:1848kB shmem:988kB slab_reclaimable:8408kB slab_unreclaimable:12632kB kernel_stack:13152kB pagetables:7164kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1340[ 8325.006789] lowmem_reserve[]: 0 0 0 0
1341[ 8325.006948] DMA: 25*4kB 41*8kB 17*16kB 8*32kB 1*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2044kB
1342[ 8325.007310] Normal: 699*4kB 2*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2812kB
1343[ 8325.007665] 13298 total pagecache pages
1344[ 8325.007702] 12163 pages in swap cache
1345[ 8325.007740] Swap cache stats: add 5710169, delete 5698006, find 761230/1468044
1346[ 8325.007779] Free swap  = 0kB
1347[ 8325.007813] Total swap = 407544kB
1348[ 8325.009955] 131056 pages RAM
1349[ 8325.010050] 0 pages HighMem
1350[ 8325.010088] 3737 pages reserved
1351[ 8325.010125] 8923 pages shared
1352[ 8325.010163] 117777 pages non-shared
1353[ 8325.010206] Out of memory: kill process 32319 (java) score 108384 or a child
1354[ 8325.010253] Killed process 32319 (java)
1355[ 8327.833760] munin-graph invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1356[ 8327.833984] munin-graph cpuset=/ mems_allowed=0
1357[ 8327.834028] Pid: 32276, comm: munin-graph Not tainted 2.6.32-24-generic #39-Ubuntu
1358[ 8327.834068] Call Trace:
1359[ 8327.834140]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
1360[ 8327.834207]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
1361[ 8327.834273]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
1362[ 8327.834339]  [<c01cd998>] out_of_memory+0x58/0xb0
1363[ 8327.834405]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
1364[ 8327.834473]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
1365[ 8327.834540]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
1366[ 8327.834608]  [<c01d2af6>] ra_submit+0x26/0x30
1367[ 8327.834673]  [<c01ccaec>] filemap_fault+0x3dc/0x410
1368[ 8327.834739]  [<c0203f1f>] ? mem_cgroup_charge_common+0x5f/0x80
1369[ 8327.834812]  [<c01e5040>] __do_fault+0x40/0x490
1370[ 8327.834877]  [<c01e5f71>] ? do_wp_page+0xe1/0x820
1371[ 8327.834943]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1372[ 8327.835011]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1373[ 8327.835077]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1374[ 8327.835143]  [<c058d0b3>] error_code+0x73/0x80
1375[ 8327.835180] Mem-Info:
1376[ 8327.835214] DMA per-cpu:
1377[ 8327.835250] CPU    0: hi:    0, btch:   1 usd:   0
1378[ 8327.835287] Normal per-cpu:
1379[ 8327.835324] CPU    0: hi:  186, btch:  31 usd:  47
1380[ 8327.835386] active_anon:56693 inactive_anon:56697 isolated_anon:0
1381[ 8327.835398]  active_file:115 inactive_file:274 isolated_file:0
1382[ 8327.835409]  unevictable:0 dirty:2 writeback:16 unstable:0
1383[ 8327.835420]  free:1186 slab_reclaimable:2108 slab_unreclaimable:3731
1384[ 8327.835432]  mapped:102 shmem:248 pagetables:1781 bounce:0
1385[ 8327.835488] DMA free:2052kB min:84kB low:104kB high:124kB active_anon:972kB inactive_anon:1016kB active_file:28kB inactive_file:48kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:8kB writeback:0kB mapped:16kB shmem:4kB slab_reclaimable:24kB slab_unreclaimable:2296kB kernel_stack:2072kB pagetables:20kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:24 all_unreclaimable? no
1386[ 8327.835558] lowmem_reserve[]: 0 492 492 492
1387[ 8327.835737] Normal free:2692kB min:2792kB low:3488kB high:4188kB active_anon:225800kB inactive_anon:225772kB active_file:432kB inactive_file:1048kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503872kB mlocked:0kB dirty:0kB writeback:64kB mapped:392kB shmem:988kB slab_reclaimable:8408kB slab_unreclaimable:12628kB kernel_stack:13136kB pagetables:7104kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1273 all_unreclaimable? no
1388[ 8327.835809] lowmem_reserve[]: 0 0 0 0
1389[ 8327.835968] DMA: 27*4kB 48*8kB 14*16kB 8*32kB 1*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2060kB
1390[ 8327.836538] Normal: 667*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2692kB
1391[ 8327.836893] 12215 total pagecache pages
1392[ 8327.836929] 11561 pages in swap cache
1393[ 8327.836967] Swap cache stats: add 5711709, delete 5700148, find 761275/1468287
1394[ 8327.837006] Free swap  = 0kB
1395[ 8327.837040] Total swap = 407544kB
1396[ 8327.838372] 131056 pages RAM
1397[ 8327.838430] 0 pages HighMem
1398[ 8327.838464] 3737 pages reserved
1399[ 8327.838499] 4078 pages shared
1400[ 8327.838533] 122081 pages non-shared
1401[ 8327.838573] Out of memory: kill process 1360 (gnome-session) score 80128 or a child
1402[ 8327.838618] Killed process 1395 (ssh-agent)
1403[ 8329.097458] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1404[ 8329.097604] java cpuset=/ mems_allowed=0
1405[ 8329.097647] Pid: 32080, comm: java Not tainted 2.6.32-24-generic #39-Ubuntu
1406[ 8329.097690] Call Trace:
1407[ 8329.097766]  [<c01cd1f4>] oom_kill_process+0xa4/0x2b0
1408[ 8329.097834]  [<c01cd869>] ? select_bad_process+0xa9/0xe0
1409[ 8329.097900]  [<c01cd8f1>] __out_of_memory+0x51/0xa0
1410[ 8329.097966]  [<c01cd998>] out_of_memory+0x58/0xb0
1411[ 8329.098033]  [<c01d01a7>] __alloc_pages_slowpath+0x407/0x4a0
1412[ 8329.098100]  [<c01d037a>] __alloc_pages_nodemask+0x13a/0x170
1413[ 8329.098168]  [<c01d29ba>] __do_page_cache_readahead+0xea/0x200
1414[ 8329.098276]  [<c01d2af6>] ra_submit+0x26/0x30
1415[ 8329.098342]  [<c01ccaec>] filemap_fault+0x3dc/0x410
1416[ 8329.098408]  [<c01e5040>] __do_fault+0x40/0x490
1417[ 8329.098474]  [<c01e6c49>] handle_mm_fault+0x139/0x390
1418[ 8329.098543]  [<c058f1bd>] do_page_fault+0x10d/0x3a0
1419[ 8329.098609]  [<c058f0b0>] ? do_page_fault+0x0/0x3a0
1420[ 8329.098675]  [<c058d0b3>] error_code+0x73/0x80
1421[ 8329.098712] Mem-Info:
1422[ 8329.098747] DMA per-cpu:
1423[ 8329.098784] CPU    0: hi:    0, btch:   1 usd:   0
1424[ 8329.098821] Normal per-cpu:
1425[ 8329.098858] CPU    0: hi:  186, btch:  31 usd:  86
1426[ 8329.098907] active_anon:56568 inactive_anon:56633 isolated_anon:0
1427[ 8329.098919]  active_file:138 inactive_file:219 isolated_file:32
1428[ 8329.098937]  unevictable:0 dirty:9 writeback:10 unstable:0
1429[ 8329.098948]  free:1311 slab_reclaimable:2107 slab_unreclaimable:3731
1430[ 8329.098960]  mapped:170 shmem:247 pagetables:1772 bounce:0
1431[ 8329.099017] DMA free:2056kB min:84kB low:104kB high:124kB active_anon:972kB inactive_anon:1012kB active_file:20kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15852kB mlocked:0kB dirty:12kB writeback:0kB mapped:28kB shmem:4kB slab_reclaimable:24kB slab_unreclaimable:2296kB kernel_stack:2088kB pagetables:20kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:72 all_unreclaimable? no
1432[ 8329.099087] lowmem_reserve[]: 0 492 492 492
1433[ 8329.099268] Normal free:3188kB min:2792kB low:3488kB high:4188kB active_anon:225300kB inactive_anon:225520kB active_file:532kB inactive_file:844kB unevictable:0kB isolated(anon):0kB isolated(file):128kB present:503872kB mlocked:0kB dirty:24kB writeback:40kB mapped:652kB shmem:984kB slab_reclaimable:8404kB slab_unreclaimable:12628kB kernel_stack:13136kB pagetables:7068kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1728 all_unreclaimable? yes
1434[ 8329.099341] lowmem_reserve[]: 0 0 0 0
1435[ 8329.099531] DMA: 28*4kB 47*8kB 14*16kB 8*32kB 1*64kB 6*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2056kB
1436[ 8329.099891] Normal: 777*4kB 8*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3188kB
1437[ 8329.100457] 12059 total pagecache pages
1438[ 8329.100493] 11412 pages in swap cache
1439[ 8329.100531] Swap cache stats: add 5712149, delete 5700737, find 761282/1468340
1440[ 8329.100570] Free swap  = 0kB
1441[ 8329.100604] Total swap = 407544kB
1442[ 8329.101959] 131056 pages RAM
1443[ 8329.102350] 0 pages HighMem
1444[ 8329.102386] 3737 pages reserved
1445[ 8329.102421] 4195 pages shared
1446[ 8329.102455] 121875 pages non-shared
1447[ 8329.102496] Out of memory: kill process 1360 (gnome-session) score 79717 or a child
1448[ 8329.102542] Killed process 1428 (nm-applet)