2009-08-20

• E2GC2 Paper 排版
• hadoop.nchc.org.tw 系統調校
  • 2009-08-19 waue & wade 已經新增硬碟
    • waue 修改 drbl-hadoop-mount-disk
    • 把 /dev/sda1 掛到 /var/lib/hadoop/
    • 把 /dev/sdb1 掛到 /var/lib/hadoop/cache/hadoop/mapred
  • 使用 dphys-swapfile 來附掛 swap
    • 設定預設 SWAP 掛載路徑

      # /etc/dphys-swapfile - user settings for dphys-swapfile package
      # author Neil Franklin, last modification 2006.09.15
      # copyright ETH Zuerich Physics Departement
      #   use under either modified/non-advertising BSD or GPL license
      # this file is sourced with . so full normal sh syntax applies
      
      # where we want the swapfile to be, this is the default
      CONF_SWAPFILE=/var/lib/hadoop/swap
      
      # size we want to force it to be, default (empty) gives 2*RAM
      # CONF_SWAPSIZE=2048
      
      ##
      #  Give yourself three times the memory size of swap?
      #
      # mem=$(grep MemTotal /proc/meminfo |awk '{print $2}')
      # CONF_SWAPSIZE=$(expr $mem \* 3)
      #
      

    • 將 dphys-swapfile 加入預設起始程序。
    • [注意] 由於 drbl-hadoop-mount-disk 必須在 dphys-swapfile 之前執行，預設 update-rc.d script defaults 都會加到 S20，會造成 dphy-swapfile 比 drbl-hadoop-mount-disk 早執行，將造成開機後找不到 swapfile 的問題。

      ~$ sudo dsh -a update-rc.d dphys-swapfile defaults 90
      

  • 關閉只有 2GB 的計算節點