wiki:rock/paper/PFS_HPC
close Warning: Can't synchronize with repository "(default)" (Unsupported version control system "svn": /usr/lib/python2.7/dist-packages/libsvn/_fs.so: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.

Version 12 (modified by rock, 15 years ago) (diff)

--

Parallel File Systems: File Systems for HPC Clusters

1. 作者將 Cluster FS 分為兩類:

  • DFS (Distributed File Systems)
    • ”parallel” as they utilize multiple data servers
  • PFS (Parallel File Systems)
    • use a single server, are not necessarily parallel, they can give the user ”parallel access” to a file system.

2. DFS


3. PFS

  • Provide lots of I/O for clusters
  • provide a centralized file system for clusters
    • Centralized file systems can ease a management burden & improve the scalability of cluster storage
  • PFS are distinguished from DFS because the clients contact multiple storage devices instead of a single device or a gateway
  • 作者將 PFS 分為兩類:
    1. First Type -> uses more traditional methods such as file locking as part of the file system (block based, or even file based, schemes)
    2. Second type: Object based file systems


想法

  • 此篇論點屬 survey 性質,可用於撰寫 DFS Paper 的文獻探討
  • 第三代的 PFS (Object based FS) 改善了 Meta server 上的效能瓶頸,讓 Storage server 分擔了 data allocation

Attachments (3)

Download all attachments as: .zip