{{{ #!html
雲端運算基礎課程(一)
Hadoop簡介、安裝與範例實作
}}} [[PageOutline]] = 課程資訊 = * 上課時間： 2012/10/15 (一) ～ 2012/10/16 (二) 09:30 ～ 16:30 2 天，共計 12 個小時 * 上課地點： 國家高速網路與計算中心 台南事業群(74147 台南市新市區南科三路28號) <[http://www.nchc.org.tw/tw/about/traffic/google_map.php?q=%A5x%ABn%A4%C0%B3%A1 地圖]> 電腦教室(一) * [https://edu.nchc.org.tw/course/one_course_introduction.asp?lms_auto_course_id=2071&from_course_list_url=homepage 報名網頁課程資訊] = 課程大綱 = == '''2012/10/15 (一)''' == || 上午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 09:30~11:10 || [raw-attachment:wiki:NCHCCloudCourse110224:00-1.CourseOutline.pdf 介紹課程] 與 [raw-attachment:wiki:NCHCCloudCourse100427:01.CloudIntro.pdf 雲端運算簡介] || [raw-attachment:wiki:NCHCCloudCourse110224:00-1.CourseOutline.pdf Part-00], [raw-attachment:wiki:NCHCCloudCourse110224:01.CloudIntro.pdf Part-01(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:01.CloudIntro.ppt Part-01(ppt)] || || 1. [http://hunch.net/?p=249 Parallel Machine Learning Problems][[BR]]2. 影像處理參考：[raw-attachment:wiki:jazz/09-11-10:09-11-12_hadoop-tw-09.pdf 吳冠龍先生，台大資工系通訊與多媒體實驗室][[BR]] Image Selection for Large-Scale Flickr Photos using Hadoop[[BR]]3. ACM 論文:[http://portal.acm.org/citation.cfm?id=1631528 Canonical image selection ...][[BR]]4. [http://hpc.asu.edu/files/Customizing%20Input%20File%20Formats%20for%20Image%20Processing%20in%20Hadoop_0.pdf Customizing InputFileFormats for Image Processing in Hadoop],Jeff Conner, Arizona State University || || 11:10~11:20 || 休息 || || || || || 11:20~11:50 || [raw-attachment:wiki:NCHCCloudCourse110224:02.HadoopIntro.pdf Hadoop簡介] || [raw-attachment:wiki:NCHCCloudCourse110224:02.HadoopIntro.pdf Part-02(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:02.HadoopIntro.ppt Part-02(ppt)] || || || || 11:50~12:00 || [wiki:Hadoop_Lab1 實作A： Hadoop 單機安裝與基本操作 ] || || [wiki:Hadoop_Lab1 實作A]|| || || 下午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 13:00~13:30 || [raw-attachment:wiki:NCHCCloudCourse110224:03.HadoopOverview.pdf Hadoop Overview] || [raw-attachment:wiki:NCHCCloudCourse110224:03.HadoopOverview.pdf Part-03(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:03.HadoopOverview.ppt Part-03(ppt)]|| || || || 13:30~14:30 || [raw-attachment:wiki:NCHCCloudCourse100427:04.HDFS.pdf Hadoop Distributed File System簡介] || [raw-attachment:wiki:NCHCCloudCourse100427:04.HDFS.pdf Part-04(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:04.HDFS_0305.ppt Part-04(ppt)] || || || || 14:30~14:40 || [wiki:Hadoop_Lab2 實作B： HDFS 實用指令操作] || || [wiki:Hadoop_Lab2 實作B] || || || 14:40~14:50 || 休息 || || || || || 14:50~15:30 || [raw-attachment:wiki:NCHCCloudCourse110224:05.MapReduce_0305.pdf Map Reduce 介紹] || [raw-attachment:wiki:NCHCCloudCourse110224:05.MapReduce_0305.pdf Part-05(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:05.MapReduce_0305.ppt Part-05(ppt)] || || [grid:wiki:jazz/09-04-14#MapReduce 不同語言的 MapReduce 實作] || || 15:30~15:50 || [wiki:Hadoop_Lab3 實作C： 執行 MapReduce 基本運算] || || [wiki:Hadoop_Lab3 實作C] || || || 15:50~16:25 || [raw-attachment:wiki:NCHCCloudCourse110224:04-5.HadoopSetupCommand.pdf 設定參數解析 ] || [raw-attachment:wiki:NCHCCloudCourse110224:04-5.HadoopSetupCommand.pdf Part-5.5(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:04-5.HadoopSetupCommand.ppt Part-5.5(ppt)] || || [http://forum.hadoop.tw/viewtopic.php?f=4&t=45 關於 master / slave 設定]|| || 16:25~16:30 || [wiki:hadoopStop 回家前停止hadoop服務] || || [wiki:hadoopStop 停止Hadoop] || || == ''' 2012/10/16 (二)''' == * 請先 [wiki:hadoopReBuild 啟動Hadoop] || 上午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 09:30~10:30 || [raw-attachment:wiki:NCHCCloudCourse110224:06.MR_Programing.pdf Map Reduce 程式設計] || [raw-attachment:wiki:NCHCCloudCourse110224:06.MR_Programing_0305.pdf Part-06(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:06.MR_Programing_0305.ppt Part-06(ppt)] || ||[wiki:NCHCCloudCourse100928_4_EXM 更多程式練習範例] || || 10:30~11:00 || [wiki:Hadoop_Lab4 實作D： Hadoop 程式編譯與執行] || || [wiki:Hadoop_Lab4 實作D] || 1. [wiki:Hadoop_Lab10 更多教材] [[br]] 2. [wiki:Streaming Streaming 用法 ] || || 11:00~11:10 || 休息 || || || || || 11:10~12:00 || [wiki:NCHCCloudCourse100928_2_IDE 用 Eclipse 開發 hadoop 程式 ] || || [wiki:NCHCCloudCourse100928_2_IDE Demo ] || 基於 !NetBeans 的 MapReduce 開發環境 - [http://www.hadoopstudio.org/ Hadoop Studio] [http://archive.eclipse.org/eclipse/downloads/drops/R-3.3.2-200802211800/index.php#EclipseSDK Eclipse3.3]|| || 下午時段 || 課程內容 || 投影片 || 實作步驟 || || 13:00~13:30 || [raw-attachment:wiki:NCHCCloudCourse110224:07.Nutch.pdf Hadoop 應用實例： 搜尋引擎 Nutch 簡介] || [raw-attachment:wiki:NCHCCloudCourse110224:07.Nutch_0305.pdf Part-07(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:07.Nutch_0305.ppt Part-07(ppt)] ||[wiki:Hadoop_Lab6 實作E] || || || 13:30~13:50 || Hadoop 應用實例(續)： 搜尋引擎 Crawlzilla安裝與使用 || [raw-attachment:wiki:NCHCCloudCourse110224:07-1.crawlzilla.pdf Part-07-1(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:07-1.crawlzilla.pptx Part-07-1(pptx)] || [wiki:crawlzilla/install_zh 實作E-1] || || || 13:50~14:20 || [raw-attachment:wiki:NCHCCloudCourse110224:08.HadoopCluster_0305.pdf Hadoop 叢集安裝設定解析] || [raw-attachment:wiki:NCHCCloudCourse110224:08.HadoopCluster_0305.pdf Part-08(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:08.HadoopCluster_0305.ppt Part-08(ppt)] || || Yahoo Hadoop Tutorial:[[BR]] [http://developer.yahoo.com/hadoop/tutorial/module7.html Module 7: Managing a Hadoop Cluster][[BR]]- 說明了小中大不同等級叢集可以做的 Hadoop 系統參數調整 || || 14:20~15:50 || [wiki:Hadoop_Lab7 實作F： Hadoop 叢集安裝操作] || || [wiki:Hadoop_Lab7 實作F] || || 15:50~15:10 || [wiki:Hadoop_Lab8 實作G： Hadoop 叢集進階操作] || || [wiki:Hadoop_Lab8 實作G] || || 16:10~16:20 || 休息 || || || || 16:20~16:30 || [wiki:Hadoop_Lab9 實作H：DRBL 快速佈屬 Hadoop] || [raw-attachment:wiki:NCHCCloudCourse100225:09.HadoopDRBL.pdf Part-09(pdf)], [raw-attachment:wiki:NCHCCloudCourse100225:09.HadoopDRBL.ppt Part-09(ppt)] || [wiki:Hadoop_Lab9 實作H] || [http://www.youtube.com/watch?v=Ix4WigGvE_A DRBL-Hadoop Live CD 展示] ( 6 min ) || || || [raw-attachment:wiki:NCHCCloudCourse090428:10.Conclusions.pdf 課程小結] || [raw-attachment:wiki:NCHCCloudCourse100225:10.Conclusions.pdf Part-10] || || ||