{{{ #!html
雲端運算基礎課程 (Hadoop簡介、安裝與範例實作)
}}} [[PageOutline]] = 課程資訊 = * 上課時間: 2009/11/24(二) ~ 2009/11/25(三) 09:30 ~ 16:30 2 天,共計 12 個小時 * 上課地點: 國家高速網路與計算中心 新竹事業群(300 新竹市科學工業園區研發六路七號) <[http://www.nchc.org.tw/tw/about/traffic/headquarter.php 地圖]> 電腦教室 B * [https://edu.nchc.org.tw/course/one_course_introduction.asp?lms_auto_course_id=1227&from_course_list_url=course_search 報名網頁課程資訊] = 課程大綱 = == '''2009-11-24 (二) == || 上午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 09:30~11:10 || [raw-attachment:wiki:NCHCCloudCourse091111:0.ppt 介紹課程] 與 [raw-attachment:wiki:NCHCCloudCourse091111:01.CloudIntro.pdf 雲端運算簡介] || [raw-attachment:wiki:NCHCCloudCourse091111:0.pdf Part-00], [raw-attachment:wiki:NCHCCloudCourse091111:01.CloudIntro.pdf Part-01] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQF5aX1NYU1Bc 課程介紹與雲端運算簡介] (101 min) [[BR]] 1. [raw-attachment:wiki:NCHCCloudCourse091111:0A.Grid_vs_Cloud.pdf <不負責解析> 格網運算與雲端運算的差異][[BR]]2. 影像處理參考:[raw-attachment:wiki:jazz/09-11-10:09-11-12_hadoop-tw-09.pdf 吳冠龍先生,台大資工系通訊與多媒體實驗室][[BR]] Image Selection for Large-Scale Flickr Photos using Hadoop[[BR]]3. ACM 論文:[http://portal.acm.org/citation.cfm?id=1631528 Canonical image selection ...] || || 11:10~11:20 || 休息 || || || || || 11:20~11:50 || [raw-attachment:wiki:NCHCCloudCourse091111:02.HadoopIntro.ppt Hadoop簡介] || [raw-attachment:wiki:NCHCCloudCourse091111:02.HadoopIntro.pdf Part-02] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQF5aXl9eX15T Hadoop 簡介] (27 min) || || 11:50~12:00 || [wiki:Hadoop_Lab1 實作A: Hadoop 單機安裝與基本操作 ] || || [wiki:Hadoop_Lab1 實作A]|| || || 下午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 13:00~13:40 || [raw-attachment:wiki:NCHCCloudCourse091111:03.HadoopOverview.ppt Hadoop Overview] || [raw-attachment:wiki:NCHCCloudCourse091111:03.HadoopOverview.pdf Part-03] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQFlaW1lYVVBT Hadoop 組成架構概論 與 ][[br]][http://www.screentoaster.com/watch/stUklTQ0dIR1xWQFlaW1lYVVBT Hadoop Distributed File System 簡介] (72 min) || || 13:40~14:00 || [raw-attachment:wiki:NCHCCloudCourse091111:04.HDFS.ppt Hadoop Distributed File System簡介] || [raw-attachment:wiki:NCHCCloudCourse091111:04.HDFS.ppt Part-04] || || || || 15:00~15:10 || [wiki:Hadoop_Lab2 實作B: HDFS 實用指令操作] || || [wiki:Hadoop_Lab2 實作B] || || || 15:10~15:20 || 休息 || || || || || 15:20~16:00 || [raw-attachment:wiki:NCHCCloudCourse091111:05.MapReduce.ppt Map Reduce 介紹] || [raw-attachment:wiki:NCHCCloudCourse091111:05.MapReduce.ppt Part-05] || || Map-Reduce 介紹 (0 min, 錄影失敗) || || 16:00~16:30 || [wiki:Hadoop_Lab3 實作C: 執行 MapReduce 基本運算] || || [wiki:Hadoop_Lab3 實作C] || 1. [http://hpc.asu.edu/files/Customizing%20Input%20File%20Formats%20for%20Image%20Processing%20in%20Hadoop_0.pdf Customizing Input File Formats for Image Processing in Hadoop],[[BR]] Jeff Conner, Arizona State University || == '''2009-11-25 (三)''' == || 上午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 09:30~10:00 || [raw-attachment:wiki:NCHCCloudCourse091111:04_5.HadoopSetupCommand.ppt 重點複習 ] || [raw-attachment:wiki:NCHCCloudCourse091111:04_5.HadoopSetupCommand.ppt Part-5.5] || [wiki:hadoopReBuild 重新建立新Hadoop] || || || 10:00~10:30 || [raw-attachment:wiki:NCHCCloudCourse091111:06.MR_Programing.ppt Map Reduce 程式設計] || [raw-attachment:wiki:NCHCCloudCourse091111:06.MR_Programing.ppt Part-06] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQV9cWF9aUlVT Map Reduce 程式設計] (53 min) || || 10:30~11:00 || [wiki:Hadoop_Lab4 實作D: Hadoop 程式編譯與執行] || || [wiki:Hadoop_Lab4 實作D] || 1. [wiki:Streaming Streaming 用法 ] || || 11:00~11:10 || 休息 || || || || || 11:10~12:00 || [raw-attachment:wiki:NCHCCloudCourse091111:07.Nutch.ppt Hadoop 應用實例: 搜尋引擎 Nutch 簡介] || [raw-attachment:wiki:NCHCCloudCourse091111:07.Nutch.ppt Part-07] ||[wiki:Hadoop_Lab6 實作E] || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQV9eWFxQUVBc 搜尋引擎 Nutch 簡介] (29 min) || || 下午時段 || 課程內容 || 投影片 || 實作步驟 || || 13:00~14:00 || [raw-attachment:wiki:NCHCCloudCourse091111:08.HadoopCluster.ppt Hadoop 叢集安裝設定解析] || [raw-attachment:wiki:NCHCCloudCourse091111:08.HadoopCluster.ppt Part-08] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQV5bUlNZUVVQ Hadoop 叢集安裝設定解析] (128 min) || || 14:00~15:00 || [wiki:Hadoop_Lab7 實作F: Hadoop 叢集安裝操作] || || [wiki:Hadoop_Lab7 實作F] || || 15:00~15:30 || [wiki:Hadoop_Lab8 實作G: Hadoop 叢集進階操作] || || [wiki:Hadoop_Lab8 實作G] || || 15:30~15:40 || 休息 || || || || 15:40~16:30 || [wiki:Hadoop_Lab9 實作H:DRBL 快速佈屬 Hadoop] || [raw-attachment:wiki:NCHCCloudCourse091111:09.HadoopDRBL.pdf Part-09] || [wiki:Hadoop_Lab9 實作H] || [http://www.screentoaster.com/watch/stUklTQ0dIR1xYSF9eU1xcVVFS DRBL-Hadoop Live CD 展示] ( 6 min ) || || || [raw-attachment:wiki:NCHCCloudCourse090428:10.Conclusions.ppt 課程小結] || [raw-attachment:wiki:NCHCCloudCourse091111:10.Conclusions.ppt Part-10] || || 1. [grid:wiki:jazz/09-04-14#MapReduce 不同語言的 MapReduce 實作] || = 補充資料 = || 課程錄影連結 || 1. [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQF5aXl9eX15T Hadoop 簡介] (27 min) [[BR]] 2. [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQFlaW1lYVVBT Hadoop 架構與 HDFS 簡介] (72 min) [[BR]] 3. [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQV9cWF9aUlVT Map Reduce 程式設計] (53 min) [[BR]] 4. [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQV9eWFxQUVBc 搜尋引擎 Nutch 簡介] (29 min) [[BR]] 5. [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQV5bUlNZUVVQ Hadoop 叢集安裝設定解析] (128 min) [[BR]] 6. [http://www.screentoaster.com/watch/stUklTQ0dIR1xYSF9eU1xcVVFS DRBL-Hadoop Live CD 展示] ( 6 min ) || * 補充:[wiki:Hadoop_Lab5 用 Eclipse 開發 hadoop 程式 ]