[[PageOutline]] = Lustre vs. GPFS Performance = == 1.Use Bonnie++ == * Lustre ('''without''' NFS tunning, kernel io scheduler = '''default''') {{{ [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root -m first Using uid:0, gid:0. Writing with putc()...done Writing intelligently...done Rewriting...done Reading with getc()...done Reading intelligently...done start 'em...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.03c ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP first 16000M:1024k 44277 73 44487 6 20676 7 44695 90 49761 12 60.2 17 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 6706 35 2971 31 5324 36 6314 37 2995 33 5812 36 first,16000M:1024k,44277,73,44487,6,20676,7,44695,90,49761,12,60.2,17,16,6706,35,2971,31,5324,36,6314,37,2995,33,5812,36 }}} * GPFS ('''without''' NFS tunning, kernel io scheduler = '''default''') {{{ gpfs-server:/home/gpfs_mount# bonnie++ -d /home/gpfs_mount/ -s 16000:1048576 -r 1024 -u root -m first > bonnie_1.txt Using uid:0, gid:0. Writing with putc()...done Writing intelligently...done Rewriting...done Reading with getc()...done Reading intelligently...done start 'em...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.03c ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP first 16000M:1024k 53765 87 53533 5 23315 3 47185 81 45355 4 26.9 2 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 284 1 1074 0 554 1 370 1 1533 3 312 1 first,16000M:1024k,53765,87,53533,5,23315,3,47185,81,45355,4,26.9,2,16,284,1,1074,0,554,1,370,1,1533,3,312,1 }}} [[BR]] * Compare * Sequential Output (K/sec) * [[Image(bonnie_1.png)]] * Sequential Input (K/sec) * [[Image(bonnie_2.png)]] * Random (sec) * [[Image(bonnie_3.png)]] * Sequential Create (sec) * [[Image(bonnie_4.png)]] * Random Create (sec) * [[Image(bonnie_5.png)]] [[BR]] * Lustre ('''with''' NFS tunning, kernel io scheduler = '''default''') {{{ Version 1.03c ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP first 16000M:1024k 41030 75 59535 9 26237 10 47504 96 64738 17 68.0 21 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 6802 36 3005 32 5248 36 6308 38 3029 35 5351 35 first,16000M:1024k,41030,75,59535,9,26237,10,47504,96,64738,17,68.0,21,16,6802,36,3005,32,5248,36,6308,38,3029,35,5351,35 }}} * GPFS ('''with''' NFS tunning, kernel io scheduler = '''default''') {{{ Version 1.03c ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP first 16000M:1024k 53120 88 52495 4 24899 3 40612 69 47325 4 26.6 2 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 356 1 899 1 448 1 273 1 1393 2 308 1 first,16000M:1024k,53120,88,52495,4,24899,3,40612,69,47325,4,26.6,2,16,356,1,899,1,448,1,273,1,1393,2,308,1 }}}