wiki:rock/paper/PFS_HPC/PFS-type2

Version 1 (modified by rock, 15 years ago) (diff)

--

1. Brief Introduction to Object Based Storage

  • In a more classic file system, such as a block based file system
    • the metadata manager is contacted and a set of inodes or blocks is allocated for a file
    • Metadata manager is responsible not only for the metadata itself but also where the data is located on the storage.
    • Metadata manager is a key part of the process. It also creates the potential for a performance problem.
  • Object storage takes a different approach allowing the storage devices themselves to manage where the data is stored.
    • metadata manager and storage are usually separate devices
    • metadata manager is contacted by a client about a file operation, such as a write.
    • metadata manager gets out of the way of the actual file operation and allows the client to directly contact the assigned storage devices
    • The metadata manager constantly monitors the operations
      • If there is a change in the file operation, such as another client wanting to read or write data to the file, then the metadata manager has to get involved to arbitrate the file operations
    • In general, the data operations happen without the metadata manager being in the middle


2. The Advantage to Object Based Storage

  • 如同開車到百貨公司 shopping,只需把車交給停車場的服務生, shopping 完後直接跟服務生拿鑰匙和停車票 (不需 Care 車子停在哪一層、那一區)
  • An object based system can optimize data layout (where your car is located), add more storage (add to the parking garage),
  • Object storage has a great deal of flexibility and possibilities for improving file system performance and scalability for clusters


3. Lustre

Attachments (1)

Download all attachments as: .zip