[[PageOutline]] = Lustre vs. GPFS Performance = == 1.Use Bonnie++ == * Lustre ('''without''' NFS tunning, kernel io scheduler = '''default''') {{{ [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root -m first Using uid:0, gid:0. Writing with putc()...done Writing intelligently...done Rewriting...done Reading with getc()...done Reading intelligently...done start 'em...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.03c ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP first 16000M:1024k 44277 73 44487 6 20676 7 44695 90 49761 12 60.2 17 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 6706 35 2971 31 5324 36 6314 37 2995 33 5812 36 first,16000M:1024k,44277,73,44487,6,20676,7,44695,90,49761,12,60.2,17,16,6706,35,2971,31,5324,36,6314,37,2995,33,5812,36 }}} * GPFS ('''without''' NFS tunning, kernel io scheduler = '''default''') {{{ gpfs-server:/home/gpfs_mount# bonnie++ -d /home/gpfs_mount/ -s 16000:1048576 -r 1024 -u root -m first > bonnie_1.txt Using uid:0, gid:0. Writing with putc()...done Writing intelligently...done Rewriting...done Reading with getc()...done Reading intelligently...done start 'em...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.03 ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP first 16000M:1024k 54899 91 54665 6 23593 3 42327 70 41545 4 26.4 3 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 373 1 1221 1 365 0 392 1 938 1 231 0 first,16000M:1024k,54899,91,54665,6,23593,3,42327,70,41545,4,26.4,3,16,373,1,1221,1,365,0,392,1,938,1,231,0 }}} [[BR]] * Lustre ('''with''' NFS tunning, kernel io scheduler = '''default''') {{{ Version 1.03c ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP first 16000M:1024k 41030 75 59535 9 26237 10 47504 96 64738 17 68.0 21 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 6802 36 3005 32 5248 36 6308 38 3029 35 5351 35 first,16000M:1024k,41030,75,59535,9,26237,10,47504,96,64738,17,68.0,21,16,6802,36,3005,32,5248,36,6308,38,3029,35,5351,35 }}} * GPFS ('''with''' NFS tunning, kernel io scheduler = '''default''') {{{ Version 1.03 ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP first 16000M:1024k 52881 85 52889 4 21749 3 24942 40 17617 1 16.3 2 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 363 1 1003 1 484 1 398 1 1176 2 275 0 first,16000M:1024k,52881,85,52889,4,21749,3,24942,40,17617,1,16.3,2,16,363,1,1003,1,484,1,398,1,1176,2,275,0 }}}