close
Warning:
Can't synchronize with repository "(default)" (Unsupported version control system "svn": /usr/lib/python2.7/dist-packages/libsvn/_fs.so: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.
- Timestamp:
-
Jun 16, 2008, 2:32:27 PM (17 years ago)
- Author:
-
chris
- Comment:
-
--
Legend:
- Unmodified
- Added
- Removed
- Modified
-
|
v22
|
v23
|
|
| 18 | 18 | [[BR]] |
| 19 | 19 | = Lustre Performance = |
| 20 | | * '''without''' NFS tunning, kernel io scheduler = '''default'''[[BR]] |
| | 20 | * 設定不同的 kernel i/o scheduler,根據 lustre 官方文件 3-8 頁所描述,最適合 Lustre 的 kernel i/o scheduler 為 deadline。[[BR]] |
| | 21 | [[Image(Lustre with diff kernel_scheduler.PNG)]] |
| | 22 | * 在 Create/Delete檔案方面,則是以 as 有較佳的表現。 |
| | 23 | [[Image(Lustre create with diff kernel_scheduler.PNG)]] |
| | 24 | * 當多個 Client 同時存取時,lustre file system 的效能有顯著的提升。 |
| | 25 | [[Image(fake multi-clients.PNG)]] |
| | 26 | |
| | 27 | * 以下是一些測試的數據: |
| | 28 | * '''without''' NFS tunning, kernel io scheduler = '''default'''[[BR]] |
| 21 | 29 | {{{ |
| 22 | 30 | [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root -m first |
| … |
… |
|
| 45 | 53 | |
| 46 | 54 | }}} |
| 47 | | * with NFS tunning, kernel io scheduler='''default'''[[BR]] |
| | 55 | * with NFS tunning, kernel io scheduler='''default'''[[BR]] |
| 48 | 56 | {{{ |
| 49 | 57 | [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root -m first |
| … |
… |
|
| 71 | 79 | first,16000M:1024k,41030,75,59535,9,26237,10,47504,96,64738,17,68.0,21,16,6802,36,3005,32,5248,36,6308,38,3029,35,5351,35 |
| 72 | 80 | }}} |
| 73 | | * with NFS tunning, kernel io scheduler = '''deadline'''[[BR]] |
| | 81 | * with NFS tunning, kernel io scheduler = '''deadline'''[[BR]] |
| 74 | 82 | {{{ |
| 75 | 83 | [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root -m first |
| … |
… |
|
| 97 | 105 | first,16000M:1024k,48900,79,59534,10,26680,10,47398,96,66517,18,70.0,22,16,6954,38,3050,33,6233,35,7125,34,2981,34,5416,36 |
| 98 | 106 | }}} |
| 99 | | * without nfs tunning, kernel io scheduler = '''cfq'''[[BR]] |
| | 107 | * without nfs tunning, kernel io scheduler = '''cfq'''[[BR]] |
| 100 | 108 | {{{ |
| 101 | 109 | [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root |
| … |
… |
|
| 123 | 131 | lustre,16000M:1024k,50986,80,46204,8,21749,8,46982,95,56664,15,65.2,21,16,8117,37,3062,31,6504,38,7041,35,2963,33,5579,34 |
| 124 | 132 | }}} |
| 125 | | * with nfs tunning, kernel io scheduler = '''cfq''' [[BR]] |
| | 133 | * with nfs tunning, kernel io scheduler = '''cfq''' [[BR]] |
| 126 | 134 | {{{ |
| 127 | 135 | [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root |
| … |
… |
|
| 149 | 157 | lustre,16000M:1024k,51603,85,48624,7,22740,8,46542,97,59096,16,67.7,21,16,6940,33,2944,34,5327,41,6141,35,2999,33,5549,39 |
| 150 | 158 | }}} |
| 151 | | * with nfs tunning, kernel io scheduler = '''as''' |
| | 159 | * with nfs tunning, kernel io scheduler = '''as''' |
| 152 | 160 | {{{ |
| 153 | 161 | [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root |
| … |
… |
|
| 175 | 183 | lustre,16000M:1024k,48623,78,51374,8,23598,9,47865,96,60014,16,68.6,21,16,8914,36,3153,31,7046,38,8020,39,3108,32,6087,39 |
| 176 | 184 | }}} |
| 177 | | * with nfs tunning, kernel io scheduler = '''noop''' |
| | 185 | * with nfs tunning, kernel io scheduler = '''noop''' |
| 178 | 186 | {{{ |
| 179 | 187 | [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root |
| … |
… |
|
| 201 | 209 | lustre,16000M:1024k,46297,74,54749,9,24791,9,47547,96,61390,16,68.4,21,16,7982,34,3036,33,5398,36,7063,35,3056,33,5341,39 |
| 202 | 210 | }}} |
| 203 | | * with nfs tunning, kernel io scheduler = noop, isolated client. |
| | 211 | * with nfs tunning, kernel io scheduler = noop, isolated client. |
| 204 | 212 | {{{ |
| 205 | 213 | [root@lustre005 bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs/ -s 16000:1048576 -r 1024 -u root |
| … |
… |
|
| 227 | 235 | lustre005,16000M:1024k,35309,98,51334,8,24285,8,35666,98,58716,14,68.2,19,16,2090,9,1593,14,1877,9,2024,9,1638,11,1891,9 |
| 228 | 236 | }}} |
| 229 | | * with nfs tunning, kernel io scheduler = '''default''', just sdb mounted , total 881 GB |
| | 237 | * with nfs tunning, kernel io scheduler = '''default''', just sdb mounted , total 881 GB |
| 230 | 238 | {{{ |
| 231 | 239 | [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root -m first |
| … |
… |
|
| 253 | 261 | first,16000M:1024k,62065,98,64754,10,27672,10,47468,96,64299,17,67.2,20,16,8385,38,3080,31,5924,37,6350,37,3056,33,5901,35 |
| 254 | 262 | }}} |
| 255 | | * without DRBL, kernel io scheduler = '''default''', just sdb mounted , total 881 GB |
| | 263 | * without DRBL, kernel io scheduler = '''default''', just sdb mounted , total 881 GB |
| 256 | 264 | {{{ |
| 257 | 265 | [root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576 -r 1024 -u root -m first |