{{{ #!html
雲端運算基礎課程(一)
Hadoop簡介、安裝與範例實作
}}} [[PageOutline]] = 課程資訊 = * 上課時間: 2012/05/30 (三) ~ 2012/05/31 (四) 09:30 ~ 16:30 2 天,共計 12 個小時 * 上課地點: 國家高速網路與計算中心 中部事業群(40763 台中市中部科學工業園區科園路22號) <[http://www.nchc.org.tw/tw/about/traffic/central_office.php 地圖]> 電腦教室 A * [https://edu.nchc.org.tw/course/one_course_introduction.asp?lms_auto_course_id=1903&from_course_list_url=course_search 報名網頁課程資訊] = 課程大綱 = == '''2012-05-30 (三)''' == || 上午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 09:30~11:00 || 淺談海量資料的趨勢、挑戰與因應對策 [[BR]] 處理海量資料的資訊架構與關鍵技術 || [raw-attachment:wiki:NCHCCloudCourse120530:01.BigData.pdf Part-01(pdf)] || || || || 11:00~11:10 || 休息 || || || || || 11:10~11:50 || [raw-attachment:wiki:NCHCCloudCourse110224:02.HadoopIntro.pdf Hadoop簡介] || [raw-attachment:wiki:NCHCCloudCourse110224:02.HadoopIntro.pdf Part-02(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:02.HadoopIntro.ppt Part-02(ppt)] || || || || 11:50~12:00 || [wiki:Hadoop_Lab1 實作A: Hadoop 單機安裝與基本操作 ] || || [wiki:Hadoop_Lab1 實作A]|| || || 下午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 13:00~13:30 || [raw-attachment:wiki:NCHCCloudCourse110224:03.HadoopOverview.pdf Hadoop Overview] || [raw-attachment:wiki:NCHCCloudCourse110224:03.HadoopOverview.pdf Part-03(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:03.HadoopOverview.ppt Part-03(ppt)]|| || || || 13:30~14:30 || [raw-attachment:wiki:NCHCCloudCourse100427:04.HDFS.pdf Hadoop Distributed File System簡介] || [raw-attachment:wiki:NCHCCloudCourse100427:04.HDFS.pdf Part-04(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:04.HDFS_0305.ppt Part-04(ppt)] || || || || 14:30~14:40 || [wiki:Hadoop_Lab2 實作B: HDFS 實用指令操作] || || [wiki:Hadoop_Lab2 實作B] || || || 14:40~14:50 || 休息 || || || || || 14:50~15:30 || [raw-attachment:wiki:NCHCCloudCourse110224:05.MapReduce_0305.pdf Map Reduce 介紹] || [raw-attachment:wiki:NCHCCloudCourse110224:05.MapReduce_0305.pdf Part-05(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:05.MapReduce_0305.ppt Part-05(ppt)] || || [grid:wiki:jazz/09-04-14#MapReduce 不同語言的 MapReduce 實作] || || 15:30~15:50 || [wiki:Hadoop_Lab3 實作C: 執行 MapReduce 基本運算] || || [wiki:Hadoop_Lab3 實作C] || || || 15:50~16:25 || [raw-attachment:wiki:NCHCCloudCourse110224:04-5.HadoopSetupCommand.pdf 設定參數解析 ] || [raw-attachment:wiki:NCHCCloudCourse110224:04-5.HadoopSetupCommand.pdf Part-5.5(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:04-5.HadoopSetupCommand.ppt Part-5.5(ppt)] || || [http://forum.hadoop.tw/viewtopic.php?f=4&t=45 關於 master / slave 設定]|| || 16:25~16:30 || [wiki:hadoopStop 回家前停止hadoop服務] || || [wiki:hadoopStop 停止Hadoop] || || == '''2012-05-31 (四)''' == * 請先 [wiki:hadoopReBuild 啟動Hadoop] || 上午時段 || 課程內容 || 投影片 || 實作步驟 || 錄影 / 補充資料 || || 09:30~10:30 || [raw-attachment:wiki:NCHCCloudCourse110224:06.MR_Programing.pdf Map Reduce 程式設計] || [raw-attachment:wiki:NCHCCloudCourse110224:06.MR_Programing_0305.pdf Part-06(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:06.MR_Programing_0305.ppt Part-06(ppt)] || ||[wiki:NCHCCloudCourse100928_4_EXM 更多程式練習範例] || || 10:30~11:00 || [wiki:Hadoop_Lab4 實作D: Hadoop 程式編譯與執行] || || [wiki:Hadoop_Lab4 實作D] || 1. [wiki:Hadoop_Lab10 更多教材] [[br]] 2. [wiki:Streaming Streaming 用法 ] || || 11:00~11:10 || 休息 || || || || || 11:10~12:00 || [wiki:NCHCCloudCourse100928_2_IDE 用 Eclipse 開發 hadoop 程式 ] || || [wiki:NCHCCloudCourse100928_2_IDE Demo ] || [wiki:NCHCCloudCourse100928/Netbeans 基於 Netbeans IDE 6.9.1 正體中文版 安裝 KamaSphere Studio 社群版] || || 下午時段 || 課程內容 || 投影片 || 實作步驟 || || 13:00~13:20 || [raw-attachment:wiki:NCHCCloudCourse110224:07.Nutch.pdf Hadoop 應用實例: 搜尋引擎 Nutch 簡介] || [raw-attachment:wiki:NCHCCloudCourse110224:07.Nutch_0305.pdf Part-07(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:07.Nutch_0305.ppt Part-07(ppt)] ||[wiki:Hadoop_Lab6 實作E] || || || 13:20~13:30 || Hadoop 應用實例(續): 搜尋引擎 Crawlzilla安裝與使用 || [raw-attachment:wiki:NCHCCloudCourse110224:07-1.crawlzilla.pdf Part-07-1(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:07-1.crawlzilla.pptx Part-07-1(pptx)] || [wiki:crawlzilla/install_zh 實作E-1] || || || 13:30~14:00 || [raw-attachment:wiki:NCHCCloudCourse110224:08.HadoopCluster_0305.pdf Hadoop 叢集安裝設定解析] || [raw-attachment:wiki:NCHCCloudCourse110224:08.HadoopCluster_0305.pdf Part-08(pdf)], [raw-attachment:wiki:NCHCCloudCourse110224:08.HadoopCluster_0305.ppt Part-08(ppt)] || || Yahoo Hadoop Tutorial:[[BR]] [http://developer.yahoo.com/hadoop/tutorial/module7.html Module 7: Managing a Hadoop Cluster][[BR]]- 說明了小中大不同等級叢集可以做的 Hadoop 系統參數調整 || || 14:00~15:00 || [wiki:Hadoop_Lab7 實作F: Hadoop 叢集安裝操作] || || [wiki:Hadoop_Lab7 實作F] || || 15:00~15:30 || [wiki:Hadoop_Lab8 實作G: Hadoop 叢集進階操作] || || [wiki:Hadoop_Lab8 實作G] || || 15:30~15:40 || 休息 || || || || 15:40~16:30 || [wiki:Hadoop_Lab9 實作H:DRBL 快速佈屬 Hadoop] || [raw-attachment:wiki:NCHCCloudCourse100225:09.HadoopDRBL.pdf Part-09(pdf)], [raw-attachment:wiki:NCHCCloudCourse100225:09.HadoopDRBL.ppt Part-09(ppt)] || [wiki:Hadoop_Lab9 實作H] || [http://www.screentoaster.com/watch/stUklTQ0dIR1xYSF9eU1xcVVFS DRBL-Hadoop Live CD 展示] ( 6 min ) || || || [raw-attachment:wiki:NCHCCloudCourse090428:10.Conclusions.pdf 課程小結] || [raw-attachment:wiki:NCHCCloudCourse100225:10.Conclusions.pdf Part-10] || || || == 補充 == * Google 的伺服器設計與 Facebook 的開放運算計畫 * [[Image(NCHCCloudCourse120530:google-server-0.png)]] * [[Image(NCHCCloudCourse120530:google-server-1.png)]] * [[Image(NCHCCloudCourse120530:google-server-2.png)]] * [[Image(NCHCCloudCourse120530:google-server-3.png)]]