2012-08-26

root@hadoop:~# hadoop jar hadoop-test.jar TestDFSIO -write -nrFiles 10 -fileSize 10000 

12/08/25 23:32:37 INFO mapred.FileInputFormat: ----- TestDFSIO ----- : write
12/08/25 23:32:37 INFO mapred.FileInputFormat: Date & time: Sat Aug 25 23:32:37 CST 2012
12/08/25 23:32:37 INFO mapred.FileInputFormat: Number of files: 10
12/08/25 23:32:37 INFO mapred.FileInputFormat: Total MBytes processed: 10000
12/08/25 23:32:37 INFO mapred.FileInputFormat: Throughput mb/sec: 13.787683462363072
12/08/25 23:32:37 INFO mapred.FileInputFormat: Average IO rate mb/sec: 13.81775188446045
12/08/25 23:32:37 INFO mapred.FileInputFormat: IO rate std deviation: 0.6458794219153966
12/08/25 23:32:37 INFO mapred.FileInputFormat: Test exec time sec: 101.908 

12/08/25 23:46:33 INFO mapred.FileInputFormat: ----- TestDFSIO ----- : write
12/08/25 23:46:33 INFO mapred.FileInputFormat: Date & time: Sat Aug 25 23:46:33 CST 2012
12/08/25 23:46:33 INFO mapred.FileInputFormat: Number of files: 10
12/08/25 23:46:33 INFO mapred.FileInputFormat: Total MBytes processed: 100000
12/08/25 23:46:33 INFO mapred.FileInputFormat: Throughput mb/sec: 13.792156069831341
12/08/25 23:46:33 INFO mapred.FileInputFormat: Average IO rate mb/sec: 13.806739807128906
12/08/25 23:46:33 INFO mapred.FileInputFormat: IO rate std deviation: 0.44646340835488985
12/08/25 23:46:33 INFO mapred.FileInputFormat: Test exec time sec: 783.54 

12/08/25 23:50:51 INFO mapred.FileInputFormat: ----- TestDFSIO ----- : write
12/08/25 23:50:51 INFO mapred.FileInputFormat: Date & time: Sat Aug 25 23:50:51 CST 2012
12/08/25 23:50:51 INFO mapred.FileInputFormat: Number of files: 18
12/08/25 23:50:51 INFO mapred.FileInputFormat: Total MBytes processed: 18000
12/08/25 23:50:51 INFO mapred.FileInputFormat: Throughput mb/sec: 10.154976220430683
12/08/25 23:50:51 INFO mapred.FileInputFormat: Average IO rate mb/sec: 10.385100364685059
12/08/25 23:50:51 INFO mapred.FileInputFormat: IO rate std deviation: 1.6564462731251788
12/08/25 23:50:51 INFO mapred.FileInputFormat: Test exec time sec: 138.842