Lustre vs. GPFS Performance

1.Use Bonnie++

• Lustre (without NFS tunning, kernel io scheduler = default)

  [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root -m first
  Using uid:0, gid:0.
  Writing with putc()...done
  Writing intelligently...done
  Rewriting...done
  Reading with getc()...done
  Reading intelligently...done
  start 'em...done...done...done...
  Create files in sequential order...done.
  Stat files in sequential order...done.
  Delete files in sequential order...done.
  Create files in random order...done.
  Stat files in random order...done.
  Delete files in random order...done.
  Version 1.03c       ------Sequential Output------ --Sequential Input- --Random-
                      -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
  Machine   Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
  first  16000M:1024k 44277  73 44487   6 20676   7 44695  90 49761  12  60.2  17
                      ------Sequential Create------ --------Random Create--------
                      -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
                files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                   16  6706  35  2971  31  5324  36  6314  37  2995  33  5812  36
  first,16000M:1024k,44277,73,44487,6,20676,7,44695,90,49761,12,60.2,17,16,6706,35,2971,31,5324,36,6314,37,2995,33,5812,36
  

• GPFS (without NFS tunning, kernel io scheduler = default)

  gpfs-server:/home/gpfs_mount# bonnie++ -d /home/gpfs_mount/ -s 16000:1048576 -r 1024 -u root -m first > bonnie_1.txt
  Using uid:0, gid:0.
  Writing with putc()...done
  Writing intelligently...done
  Rewriting...done
  Reading with getc()...done
  Reading intelligently...done
  start 'em...done...done...done...
  Create files in sequential order...done.
  Stat files in sequential order...done.
  Delete files in sequential order...done.
  Create files in random order...done.
  Stat files in random order...done.
  Delete files in random order...done.
  Version 1.03c       ------Sequential Output------ --Sequential Input- --Random-
                      -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
  Machine   Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
  first  16000M:1024k 53765  87 53533   5 23315   3 47185  81 45355   4  26.9   2
                      ------Sequential Create------ --------Random Create--------
                      -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
                files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                   16   284   1  1074   0   554   1   370   1  1533   3   312   1
  first,16000M:1024k,53765,87,53533,5,23315,3,47185,81,45355,4,26.9,2,16,284,1,1074,0,554,1,370,1,1533,3,312,1
  
  

• Compare
  • Sequential Output (K/sec)　　　　　　　　　　　　Sequential Input (K/sec)　　　　　　　　　　　　Random (sec)
    　　　　　　　　　　
    
    Sequential Create (sec)　　　　　　　　　　Random Create (sec)
    　　　　
    
• Lustre (with NFS tunning, kernel io scheduler = default)

  Version 1.03c       ------Sequential Output------ --Sequential Input- --Random-
                      -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
  Machine   Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
  first  16000M:1024k 41030  75 59535   9 26237  10 47504  96 64738  17  68.0  21
                      ------Sequential Create------ --------Random Create--------
                      -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
                files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                   16  6802  36  3005  32  5248  36  6308  38  3029  35  5351  35
  first,16000M:1024k,41030,75,59535,9,26237,10,47504,96,64738,17,68.0,21,16,6802,36,3005,32,5248,36,6308,38,3029,35,5351,35
  

• GPFS (with NFS tunning, kernel io scheduler = default)

  Version 1.03c       ------Sequential Output------ --Sequential Input- --Random-
                      -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
  Machine   Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
  first  16000M:1024k 53120  88 52495   4 24899   3 40612  69 47325   4  26.6   2
                      ------Sequential Create------ --------Random Create--------
                      -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
                files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                   16   356   1   899   1   448   1   273   1  1393   2   308   1
  first,16000M:1024k,53120,88,52495,4,24899,3,40612,69,47325,4,26.6,2,16,356,1,899,1,448,1,273,1,1393,2,308,1