close
Warning:
Can't synchronize with repository "(default)" (Unsupported version control system "svn": /usr/lib/python2.7/dist-packages/libsvn/_fs.so: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.
2013-01-30
從 PDF 抽出圖檔
Apache BigTop
- [參考] How to install Hadoop distribution from Bigtop 0.5.0
- [測試環境] http://easycloud.nchc.org.tw
root@vm36:~# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 12.04.1 LTS
Release: 12.04
Codename: precise
root@vm36:~# uname -a
Linux vm36 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
- [注意] 官方說只有支援 64 位元版本
- [步驟]
### 首先,在 EasyCloud 的 VM 切換成 root 會比較方便。
jazzwang.tw@vm36:~$ su -
### 其次,加入 BigTop 的套件金鑰,跟套件庫來源
root@vm36:~# wget -O- http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/GPG-KEY-bigtop | apt-key add -
root@vm36:~# wget -O /etc/apt/sources.list.d/bigtop-0.5.0.list http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/`lsb_release --codename --short`/bigtop.list
### 更新套件庫
root@vm36:~# apt-get update
### 安裝 BigTop Utility
root@vm36:~# apt-get install bigtop-utils
### 安裝 Oracle Java Runtime and JDK
root@vm36:~# if [ ! -x /usr/bin/add-apt-repository ]; then
sudo apt-get -f -y install python-software-properties
fi
root@vm36:~# if [ ! -x /usr/bin/java ]; then
echo "---- [1] Installing Sun Java JDK 6 ........ ----"
sudo add-apt-repository -y 'deb http://free.nchc.org.tw/debian stable non-free'
sudo apt-get update
cat << EOF | sudo /usr/bin/debconf-set-selections
sun-java6-bin shared/accepted-sun-dlj-v1-1 select true
sun-java6-jdk shared/accepted-sun-dlj-v1-1 select true
sun-java6-jre shared/accepted-sun-dlj-v1-1 select true
EOF
sudo apt-get -y --force-yes install sun-java6-jdk sun-java6-plugin
sudo add-apt-repository -r 'deb http://free.nchc.org.tw/debian stable non-free'
fi
### 設定 JAVA_HOME 到 BigTop Utility 預設值
root@vm36:~# echo "export JAVA_HOME=/usr/lib/jvm/java-6-sun" >> /etc/default/bigtop-utils
### 安裝 Hadoop 相關套件
root@vm36:~# apt-get -y install hadoop-hdfs\* hadoop-mapreduce\*
- Apache BigTop 專案主要是針對最新版本的 Apache Hadoop Ecosystem 進行整體的測試,所以版本都會是比較新的。底下是 BigTop? 0.5.0 正式釋出所產生的套件庫版本:
Apache Hadoop 2.0.2-alpha
Apache Zookeeper 3.4.5
Apache Flume 1.3.0
Apache HBase 0.94.2
Apache Pig 0.10.0
Apache Hive 0.9.0
Apache Sqoop 1.4.2
Apache Oozie 3.3.0
Apache Whirr 0.8.1
Apache Mahout 0.7
Apache Solr (SolrCloud) 4.0.0
Apache Crunch (incubating) 0.4.0
DataFu 0.0.4
Hue 2.1.0
Download in other formats: