wiki:jazz/13-01-30

2013-01-30

從 PDF 抽出圖檔

Apache BigTop

  • [參考] How to install Hadoop distribution from Bigtop 0.5.0
  • [測試環境] http://easycloud.nchc.org.tw
    root@vm36:~# lsb_release -a
    No LSB modules are available.
    Distributor ID:	Ubuntu
    Description:	Ubuntu 12.04.1 LTS
    Release:	12.04
    Codename:	precise
    root@vm36:~# uname -a
    Linux vm36 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
    
  • [注意] 官方說只有支援 64 位元版本
  • [步驟]
    ### 首先,在 EasyCloud 的 VM 切換成 root 會比較方便。
    jazzwang.tw@vm36:~$ su -
    ### 其次,加入 BigTop 的套件金鑰,跟套件庫來源
    root@vm36:~# wget -O- http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/GPG-KEY-bigtop | apt-key add -
    root@vm36:~# wget -O /etc/apt/sources.list.d/bigtop-0.5.0.list http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/`lsb_release --codename --short`/bigtop.list
    ### 更新套件庫
    root@vm36:~# apt-get update
    ### 安裝 BigTop Utility
    root@vm36:~# apt-get install bigtop-utils
    ### 安裝 Oracle Java Runtime and JDK
    root@vm36:~# if [ ! -x /usr/bin/add-apt-repository ]; then
       sudo apt-get -f -y install python-software-properties
    fi
    root@vm36:~# if [ ! -x /usr/bin/java ]; then
       echo "---- [1] Installing Sun Java JDK 6 ........ ----"
       sudo add-apt-repository -y 'deb http://free.nchc.org.tw/debian stable non-free'
       sudo apt-get update
       cat << EOF | sudo /usr/bin/debconf-set-selections
     sun-java6-bin   shared/accepted-sun-dlj-v1-1    select true
     sun-java6-jdk   shared/accepted-sun-dlj-v1-1    select true
     sun-java6-jre   shared/accepted-sun-dlj-v1-1    select true
    EOF
       sudo apt-get -y --force-yes install sun-java6-jdk sun-java6-plugin
       sudo add-apt-repository -r 'deb http://free.nchc.org.tw/debian stable non-free'
    fi
    ### 設定 JAVA_HOME 到 BigTop Utility 預設值
    root@vm36:~# echo "export JAVA_HOME=/usr/lib/jvm/java-6-sun" >> /etc/default/bigtop-utils 
    ### 安裝 Hadoop 相關套件
    root@vm36:~# apt-get -y install hadoop-hdfs\* hadoop-mapreduce\*
    
  • Apache BigTop 專案主要是針對最新版本的 Apache Hadoop Ecosystem 進行整體的測試,所以版本都會是比較新的。底下是 BigTop 0.5.0 正式釋出所產生的套件庫版本(來源)
        Apache Hadoop 2.0.2-alpha
        Apache Zookeeper 3.4.5
        Apache Flume 1.3.0
        Apache HBase 0.94.2
        Apache Pig 0.10.0
        Apache Hive 0.9.0
        Apache Sqoop 1.4.2
        Apache Oozie 3.3.0
        Apache Whirr 0.8.1
        Apache Mahout 0.7
        Apache Solr (SolrCloud) 4.0.0
        Apache Crunch (incubating) 0.4.0
        DataFu 0.0.4
        Hue 2.1.0
    
Last modified 11 years ago Last modified on Jan 30, 2013, 6:21:09 PM