wiki:jazz/09-08-20

Version 4 (modified by jazz, 15 years ago) (diff)

--

2009-08-20

  • E2GC2 Paper 排版
  • hadoop.nchc.org.tw 系統調校
    • 2009-08-19 waue & wade 已經新增硬碟
      • waue 修改 drbl-hadoop-mount-disk
      • 把 /dev/sda1 掛到 /var/lib/hadoop/
      • 把 /dev/sdb1 掛到 /var/lib/hadoop/cache/hadoop/mapred
    • 使用 dphys-swapfile 來附掛 swap
      • 設定預設 SWAP 掛載路徑
        # /etc/dphys-swapfile - user settings for dphys-swapfile package
        # author Neil Franklin, last modification 2006.09.15
        # copyright ETH Zuerich Physics Departement
        #   use under either modified/non-advertising BSD or GPL license
        # this file is sourced with . so full normal sh syntax applies
        
        # where we want the swapfile to be, this is the default
        CONF_SWAPFILE=/var/lib/hadoop/swap
        
        # size we want to force it to be, default (empty) gives 2*RAM
        # CONF_SWAPSIZE=2048
        
        ##
        #  Give yourself three times the memory size of swap?
        #
        # mem=$(grep MemTotal /proc/meminfo |awk '{print $2}')
        # CONF_SWAPSIZE=$(expr $mem \* 3)
        #
        
      • 將 dphys-swapfile 加入預設起始程序。
      • [注意] 由於 drbl-hadoop-mount-disk 必須在 dphys-swapfile 之前執行,預設 update-rc.d script defaults 都會加到 S20,會造成 dphy-swapfile 比 drbl-hadoop-mount-disk 早執行,將造成開機後找不到 swapfile 的問題。
        ~$ sudo dsh -a update-rc.d dphys-swapfile defaults 90
        
    • 關閉只有 2GB 的計算節點