Changes between Version 16 and Version 17 of jazz/08-11-04


Ignore:
Timestamp:
Nov 4, 2008, 4:43:06 PM (16 years ago)
Author:
waue
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • jazz/08-11-04

    v16 v17  
    1212$ tar zxvf hadoop-0.18.2.tar.gz
    1313}}}
     14   *  Hadoop 會用 SSH 進行內部連線,因此需要做 SSH Key exchange
     15{{{
     16~$ ssh-keygen
     17~$ cp .ssh/id_rsa.pub .ssh/authorized_keys
     18}}}
    1419   * [注意] 需要 JAVA_HOME 環境變數才能執行 hadoop namenode
    1520{{{
    1621$ echo "export JAVA_HOME=/usr/lib/jvm/java-6-sun/jre" >> ~/.bash_profile
    1722$ cd hadoop-0.18.2
    18 ~/hadoop-0.18.2$ bin/hadoop namenode -format
    1923}}}
    2024   * [注意] 還需要編輯 conf/hadoop-evn.sh (HADOOP_HOME要設定到你的hadoop安裝目錄)
     
    4852
    4953}}}
     54   * 啟動hadoop 的兩道指令
     55{{{
     56~/hadoop-0.18.2$ bin/hadoop namenode -format
     57~/hadoop-0.18.2$ bin/start-all.sh
     58}}}
    5059
    51    * 執行 bin/start-all.sh
    52 {{{
    53 ~/hadoop-0.18.2$ bin/start-all.sh
    54 starting namenode, logging to /home/jazz/hadoop-0.18.2/bin/../logs/hadoop-jazz-namenode-hadoop.out
    55 The authenticity of host 'localhost (127.0.0.1)' can't be established.
    56 RSA key fingerprint is 70:3f:8b:f2:b9:a8:de:ea:90:f4:bf:ce:cb:85:7a:eb.
    57 Are you sure you want to continue connecting (yes/no)? yes
    58 localhost: Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
    59 }}}
    60    * 從這邊的訊息可以知道 Hadoop 會用 SSH 進行內部連線,因此需要做 SSH Key exchange
    61 {{{
    62 ~$ ssh-keygen
    63 ~$ cp .ssh/id_rsa.pub .ssh/authorized_keys
    64 }}}
    6560
    6661 * 完成後可以看到以下三個網頁
     
    7166 * 可以放的東西上去看看
    7267{{{
    73 ~$ bin/hadoop dfs -put conf conf
    74 ~$ bin/hadoop dfs -ls
     68~/hadoop-0.18.2$ bin/hadoop dfs -put conf conf
     69~/hadoop-0.18.2$ bin/hadoop dfs -ls
    7570Found 1 items
    7671drwxr-xr-x   - jazz supergroup          0 2008-11-04 15:56 /user/jazz/conf