{{{ #!html
雲端運算基礎課程 (Hadoop簡介、安裝與範例實作)
}}} [[PageOutline]] = 課程資訊 = * 上課時間: 2010/03/03 (三) ~ 2010/03/04 (四) 09:30 ~ 16:30 2 天,共計 12 個小時 * 上課地點: 國家高速網路與計算中心 中部事業群(40763 台中市中部科學工業園區科園路22號) <[http://www.nchc.org.tw/tw/about/traffic/central_office.php 地圖]> 電腦教室 A * [https://edu.nchc.org.tw/course/one_course_introduction.asp?lms_auto_course_id=1290&from_course_list_url=course_index 報名網頁課程資訊] = 課程大綱 = == '''2010-03-03 (三)''' == || 上午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 09:30~11:10 || [raw-attachment:wiki:NCHCCloudCourse100225:00.CourseOutline.pdf 介紹課程] 與 [raw-attachment:wiki:NCHCCloudCourse100225:01.CloudIntro.pdf 雲端運算簡介] || [raw-attachment:wiki:NCHCCloudCourse100225:00.CourseOutline.pdf Part-00], [raw-attachment:wiki:NCHCCloudCourse100225:01.CloudIntro.pdf Part-01] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQF5aX1NYU1Bc 課程介紹與雲端運算簡介] (101 min) [[BR]] 1. [raw-attachment:wiki:NCHCCloudCourse100225:0A.Grid_vs_Cloud.pdf <不負責解析> 格網運算與雲端運算的差異][[BR]]2. 影像處理參考:[raw-attachment:wiki:jazz/09-11-10:09-11-12_hadoop-tw-09.pdf 吳冠龍先生,台大資工系通訊與多媒體實驗室][[BR]] Image Selection for Large-Scale Flickr Photos using Hadoop[[BR]]3. ACM 論文:[http://portal.acm.org/citation.cfm?id=1631528 Canonical image selection ...] || || 11:10~11:20 || 休息 || || || || || 11:20~11:50 || [raw-attachment:wiki:NCHCCloudCourse100225:02.HadoopIntro.pdf Hadoop簡介] || [raw-attachment:wiki:NCHCCloudCourse100225:02.HadoopIntro.pdf Part-02] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQF5aXl9eX15T Hadoop 簡介] (27 min) || || 11:50~12:00 || [wiki:Hadoop_Lab1 實作A: Hadoop 單機安裝與基本操作 ] || || [wiki:Hadoop_Lab1 實作A]|| || || 下午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 13:00~13:40 || [raw-attachment:wiki:NCHCCloudCourse100225:03.HadoopOverview.pdf Hadoop Overview] || [raw-attachment:wiki:NCHCCloudCourse100225:03.HadoopOverview.pdf Part-03] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQFlaW1lYVVBT Hadoop 組成架構概論 與 ][[br]][http://www.screentoaster.com/watch/stUklTQ0dIR1xWQFlaW1lYVVBT Hadoop Distributed File System 簡介] (72 min) || || 13:40~14:00 || [raw-attachment:wiki:NCHCCloudCourse100225:04.HDFS.pdf Hadoop Distributed File System簡介] || [raw-attachment:wiki:NCHCCloudCourse100225:04.HDFS.pdf Part-04] || || || || 15:00~15:10 || [wiki:Hadoop_Lab2 實作B: HDFS 實用指令操作] || || [wiki:Hadoop_Lab2 實作B] || || || 15:10~15:20 || 休息 || || || || || 15:20~16:00 || [raw-attachment:wiki:NCHCCloudCourse100225:05.MapReduce.pdf Map Reduce 介紹] || [raw-attachment:wiki:NCHCCloudCourse100225:05.MapReduce.pdf Part-05] || || Map-Reduce 介紹 (0 min, 錄影失敗) || || 16:00~16:30 || [wiki:Hadoop_Lab3 實作C: 執行 MapReduce 基本運算] || || [wiki:Hadoop_Lab3 實作C] || 1. [http://hpc.asu.edu/files/Customizing%20Input%20File%20Formats%20for%20Image%20Processing%20in%20Hadoop_0.pdf Customizing Input File Formats for Image Processing in Hadoop],[[BR]] Jeff Conner, Arizona State University || == '''2010-03-04 (四)''' == || 上午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 09:30~10:00 || [raw-attachment:wiki:NCHCCloudCourse100225:04_5.HadoopSetupCommand.pdf 重點複習 ] || [raw-attachment:wiki:NCHCCloudCourse100225:04_5.HadoopSetupCommand.pdf Part-5.5] || [wiki:hadoopReBuild 重新建立新Hadoop] || || || 10:00~10:30 || [raw-attachment:wiki:NCHCCloudCourse100225:06.MR_Programing.pdf Map Reduce 程式設計] || [raw-attachment:wiki:NCHCCloudCourse100225:06.MR_Programing.pdf Part-06] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQV9cWF9aUlVT Map Reduce 程式設計] (53 min) || || 10:30~11:00 || [wiki:Hadoop_Lab4 實作D: Hadoop 程式編譯與執行] || || [wiki:Hadoop_Lab4 實作D] || 1. [wiki:Streaming Streaming 用法 ] || || 11:00~11:10 || 休息 || || || || || 11:10~12:00 || [raw-attachment:wiki:NCHCCloudCourse100225:07.Nutch.pdf Hadoop 應用實例: 搜尋引擎 Nutch 簡介] || [raw-attachment:wiki:NCHCCloudCourse100225:07.Nutch.pdf Part-07] ||[wiki:Hadoop_Lab6 實作E] || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQV9eWFxQUVBc 搜尋引擎 Nutch 簡介] (29 min) || || 下午時段 || 課程內容 || 投影片 || 實作步驟 || || 13:00~14:00 || [raw-attachment:wiki:NCHCCloudCourse100225:08.HadoopCluster.pdf Hadoop 叢集安裝設定解析] || [raw-attachment:wiki:NCHCCloudCourse100225:08.HadoopCluster.pdf Part-08] || || [http://www.screentoaster.com/watch/stUklTQ0dIR1xWQV5bUlNZUVVQ Hadoop 叢集安裝設定解析] (128 min) || || 14:00~15:00 || [wiki:Hadoop_Lab7 實作F: Hadoop 叢集安裝操作] || || [wiki:Hadoop_Lab7 實作F] || || 15:00~15:30 || [wiki:Hadoop_Lab8 實作G: Hadoop 叢集進階操作] || || [wiki:Hadoop_Lab8 實作G] || || 15:30~15:40 || 休息 || || || || 15:40~16:30 || [wiki:Hadoop_Lab9 實作H:DRBL 快速佈屬 Hadoop] || [raw-attachment:wiki:NCHCCloudCourse100225:09.HadoopDRBL.pdf Part-09] || [wiki:Hadoop_Lab9 實作H] || [http://www.screentoaster.com/watch/stUklTQ0dIR1xYSF9eU1xcVVFS DRBL-Hadoop Live CD 展示] ( 6 min ) || || || [raw-attachment:wiki:NCHCCloudCourse090428:10.Conclusions.pdf 課程小結] || [raw-attachment:wiki:NCHCCloudCourse100225:10.Conclusions.pdf Part-10] || || 1. [grid:wiki:jazz/09-04-14#MapReduce 不同語言的 MapReduce 實作] || * 補充:[wiki:Hadoop_Lab5 用 Eclipse 開發 hadoop 程式 ]