close
Warning:
Can't synchronize with repository "(default)" (Unsupported version control system "svn": libsvn_diff-1.so.1: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.
- Timestamp:
-
May 1, 2010, 1:03:50 AM (16 years ago)
- Author:
-
jazz
- Comment:
-
--
Legend:
- Unmodified
- Added
- Removed
- Modified
-
|
v6
|
v7
|
|
| 6 | 6 | [[PageOutline]] |
| 7 | 7 | |
| 8 | | * 深入了解 Hadoop 的參考資料:http://classcloud.org/media 歷史課程錄影(兩天) |
| 9 | | * 作業討論區:http://forum.hadoop.tw |
| 10 | | * 申請 21 台 hadoop 實驗環境帳號:http://hadoop.nchc.org.tw |
| 11 | 8 | == '''2010-04-07 (三)''' == |
| 12 | 9 | |
| … |
… |
|
| 24 | 21 | || 14:30~15:00 || HDFS 操作與 MapReduce 範例程式展示 || [wiki:Hadoop_Lab2 Demo-01][[BR]][wiki:Hadoop_Lab3 Demo-02] || || |
| 25 | 22 | |
| | 23 | == 補充資料 == |
| | 24 | |
| | 25 | * STEP 1 : 使用 [http://www.cloudera.com/developers/downloads/virtual-machine/ Cloudera Hadoop 虛擬機器] 作練習 |
| | 26 | * STEP 2 : 申請 21 台 hadoop 實驗環境帳號:http://hadoop.nchc.org.tw |
| | 27 | * STEP 3 : 深入了解 Hadoop 的參考資料:http://classcloud.org/media 歷史課程錄影(兩天) |
| | 28 | * STEP 4 : 作業討論區:http://forum.hadoop.tw |
| | 29 | |
| | 30 | == 開發工具 == |
| | 31 | |
| 26 | 32 | * 補充:[wiki:Hadoop_Lab5 用 Eclipse 開發 hadoop 程式] |
| 27 | 33 | * 基於 !NetBeans 的 MapReduce 開發環境 - [http://www.hadoopstudio.org/ Karmasphere Studio for Hadoop] - Karmasphere Studio for Hadoop is a Sample screenshot MapReduce development environment (IDE) based on !NetBeans. |
| 28 | | * STEP 1: 下載 !NetBeans IDE 6.8 - [http://bits.netbeans.org/netbeans/6.8/community/fcs/bundles/netbeans-6.8-ml-javase-windows.exe Windows]/[http://bits.netbeans.org/netbeans/6.8/community/fcs/bundles/netbeans-6.8-ml-javase-linux.sh Linux]/[http://bits.netbeans.org/netbeans/6.8/community/fcs/bundles/netbeans-6.8-ml-javase-macosx.dmg Mac OS X] |
| | 34 | * STEP 1: 下載 !NetBeans IDE 6.8 - [http://bits.netbeans.org/netbeans/6.8/community/fcs/bundles/netbeans-6.8-ml-javase-windows.exe Windows] / [http://bits.netbeans.org/netbeans/6.8/community/fcs/bundles/netbeans-6.8-ml-javase-linux.sh Linux] / [http://bits.netbeans.org/netbeans/6.8/community/fcs/bundles/netbeans-6.8-ml-javase-macosx.dmg Mac OS X] |
| 29 | 35 | * STEP 2: 參考 [http://www.hadoopstudio.org/docs/tutorials/nb-tutorial-installation.html 安裝步驟] 文件,設定 JDK 路徑與安裝擴充套件 |
| 30 | 36 | * STEP 3: 參考 [http://www.hadoopstudio.org/docs/tutorials/nb-tutorial-jobdev-walkthru.html 基本入門] 文件,學習如何使用 Karmasphere Studio for Hadoop 來開發 MapReduce 程式。目前感覺它的 Job Workflow Plugin 介面,對於初學者寫程式來說,還蠻不錯的,因為可以直接看到 !InputFileFormat 的 Key 跟 Value 長怎樣。 |
| 31 | 37 | * 備註:宣稱 Karmasphere Studio for Hadoop 可以支援跨平台工作部署 - [http://www.hadoopstudio.org/docs/tutorials/tutorial-clients-intro.html Hadoop Clients and Operating System Portability][[br]][[Image(wiki:NCTU100407:10-04-27_Hadoop_Client_Portablility.jpg)]] |
| 32 | 38 | |
| 33 | | == 作業 == |
| | 39 | == 作業題組 == |
| 34 | 40 | |
| | 41 | * '''題組一與題組二,請擇一作答。''' |
| 35 | 42 | * 題組一: |
| 36 | 43 | * 使用 Cloudera Hadoop VM 練習完成 inverse index 題目撰寫。 |