1. SSH auto login
{{{
$ sudo su
Server : $ ssh ''{all client}'' 

All Node: $ ssh-keygen -t rsa
$ cd .ssh
$ cat id_rsa.pub >> authorized_keys
$ cat /tftboot/nodes/192.../root/.ssh/id_rsa.pub >> authorized_keys

$ cp authorized_keys known_hosts /tftpboot/nodes/192.../root/.ssh
}}}

 2. Config Nodes and Disks
{{{
$ vim gpfs.nodes
「gpfs00.nchc.org.tw:quorum-manager
   gpfs01.nchc.org.tw:quorum
   gpfs02.nchc.org.tw:quorum」

$ vim gpfs.disks
「/dev/sdb:gpfs01.nchc.org.tw::dataAndMetadata::
   /dev/sdb:gpfs02.nchc.org.tw::dataAndMetadata::
   /dev/sdb:gpfs03.nchc.org.tw::dataAndMetadata::」
}}}

 3. Create Cluster
{{{
$ mmdelnode -f
$ mmcrcluster -n gpfs.nodes -p gpfs01.nchc.org.tw -s gpfs02.nchc.org.tw  -r `which ssh` -R `which scp`
「-p: primary NSD \Server
   -s: secondary NSD Server
   -C: Cluster name
   -U: Domain name」

$ mmlscluster
$ mmlsnode -a
}}}

 4. Perpare Disks as NSD
{{{
$ cp gpfs.dsiks gpfs.disks.orig
$ mmcrnsd -F gpfs.disks
(mcrnsd -F gpfs.disks -v yes)

$ mmlsnsd
}}}

 5. Start GPFS daemon
{{{
$ mmstartup -a
$ mmgetstate -a
$ tsstatus
$ mmlsmod | grep mm
$ ps -aux | grep mm
}}}

 6. Create FS
{{{
$ mmcrfs /home/gpfs_mount gpfs0 -F gpfs.disks
($ mmcrfs /home/gpfs_mount gpfs0 -F gpfs.disks -A yes)
($ mmcrfs /home/gpfs_mount gpfs0 -F gpfs.disks -B 256K)
($ mmcrfs /home/gpfs_mount gpfs0 -F gpfs.disks -B 1024K -m 1 -M 2 -r 1 -R 2)
($ mmcrfs /home/gpfs_mount gpfs0 -F gpfs.disks -A yes -v no)

(/home/gpfs: mount point
 gpfs0:  fs name ex./dev/gpfs0
 -A: auto mount
 -B: block
 -n: node's amount
)

$ mmlsdisk gpfs0
$ mmlsfs gpfs0
}}}

 7. Mount FS
{{{
Method 1：$ mmcrfs /home/gpfs_mount gpfs0 -F gpfs.disks -A yes
Method 2：$ mmmount /home/gpfs_mount -a
Method 3：$ vim /etc/fstab
「/dev/gpfs0    /home/gpfs_mount    gpfs    rw,mtime,atime,dev=/dev/gpfs0,autostart 0 0」
}}}

 8. Other
{{{
Print infornation:
$ mmlsconfig

Cahange Configuration:
$ mmchconfig autoload=yes
$ mmchconfig singleNodeQuorum=no

Add node:
$ mmaddnode -N fs04:client

Shutdown: 
$ mmshutdown -a
$ mmshutdown -N node

$ rm -fr /var/mmfs....
or
$ mmdelnode -a

Delete gpfs fs: 
$ mmumount gpfs0 -a
$ mmdelfs gpfs0

 Delete gpfs NSD:
$ mmdelnsd -F gpfs.disks

Recopy single data:
$ mmrestripefs gpfs0
}}}

 9. How to add disk
{{{
$ mmcrnsd -F gpfs.adddisks
$ mmlsnsd
$ mmlsnsd -F

$ mmadddisk gpfs0 -F gpfs.adddisks -r
$ df -h
}}}