{{{
#!html
雲端計算與應用
Cloud Computing and its Applications
}}}
[[PageOutline]]
= 課程資訊 Course Info. =
* 上課時間： 2010/7/12 (一) ～ 2010/8/20 (五) 13:30 ～ 16:20
* Date and Time: 13:30 to 16:20, from 12 July 2010 to 20 Aug. 2010, every Monday, Wednesday and Friday
* 上課地點： 國家高速網路與計算中心 新竹事業群(300 新竹市科學工業園區研發六路七號) <[http://www.nchc.org.tw/tw/about/traffic/headquarter.php 地圖]> 階梯教室
* Location: No. 7, RD VI Road, Hsin-Chu, Taiwan - National Center for High-performance Computing
= 課程大綱 Course Outline =
|| 時段[[BR]]Date || 分類[[BR]]Section || 課程內容 Topics || 主講人[[BR]]Lectuer || 投影片[[BR]]Slides || 實作[[BR]]Hands-On || 補充資料[[BR]]Notes ||
|| 7/12 || Introduction || Introduction to Parallel, Cluster,[[BR]] Grid Computing and Web Service || 東海大學資工系[[BR]][http://researcher.nsc.gov.tw/ctyang/ 楊朝棟 教授][[BR]][http://web.thu.edu.tw/ctyang/ Prof. Chao-Tung Yang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-07-12_CTY_PCGWS.pdf 1-1] || || ||
|| 7/14 || Introduction || The Anatomy of cloud computing || 東海大學資工系[[BR]][http://researcher.nsc.gov.tw/ctyang/ 楊朝棟 教授][[BR]][http://web.thu.edu.tw/ctyang/ Prof. Chao-Tung Yang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-07-14_CTY_The_Anatomy_of_cloud_computing.pptx 1-2] || || [wiki:NCHCCloudCourse100802#HW1 HW1] ||
|| 7/16 || Theory || Distributed File System: Overview || 中研院資科所[[BR]][http://www.iis.sinica.edu.tw/~cmwang/ 王建民 副研究員][[BR]][http://www.iis.sinica.edu.tw/page/researcher/cmwang.html?lang=en&func=CurriculumVitae Dr. Chien-Min Wang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-07-16_DFS-1.pdf 2-1] || || ||
|| 7/19 || Theory || Distributed File Systems: Issues || 中研院資科所[[BR]][http://www.iis.sinica.edu.tw/~cmwang/ 王建民 副研究員][[BR]][http://www.iis.sinica.edu.tw/page/researcher/cmwang.html?lang=en&func=CurriculumVitae Dr. Chien-Min Wang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-07-19_DFS-2.pdf 2-2] || || ||
|| 7/21 || Theory || Distributed File Systems: Case Studies || 中研院資科所[[BR]][http://www.iis.sinica.edu.tw/~cmwang/ 王建民 副研究員][[BR]][http://www.iis.sinica.edu.tw/page/researcher/cmwang.html?lang=en&func=CurriculumVitae Dr. Chien-Min Wang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-07-21_DFS-3.pdf 2-3] || || ||
|| 7/23 || Theory || Distributed File Systems for Clouds || 中研院資科所[[BR]][http://www.iis.sinica.edu.tw/~cmwang/ 王建民 副研究員][[BR]][http://www.iis.sinica.edu.tw/page/researcher/cmwang.html?lang=en&func=CurriculumVitae Dr. Chien-Min Wang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-07-23_DFS-4.pdf 2-4] || || [wiki:NCHCCloudCourse100802#HW2-1 HW2-1][[BR]][wiki:NCHCCloudCourse100802#HW2-2 HW2-2] ||
|| 7/26 || Theory || Workload Model, Job Scheduling,[[BR]] and Resource Allocation || 台中教育大學資科系[[BR]][http://www.ntcu.edu.tw/kchuang/ 黃國展 助理教授][[BR]]Prof. Kuo-Chan Huang || [raw-attachment:wiki:NCHCCloudCourse100802:10-07-26_Workload_Mode_Job_Scheduling.pdf 3-1] || || ||
|| 7/28 || Theory || Workload Model, Job Scheduling,[[BR]] and Resource Allocation || 台中教育大學資科系[[BR]][http://www.ntcu.edu.tw/kchuang/ 黃國展 助理教授][[BR]]Prof. Kuo-Chan Huang || [raw-attachment:wiki:NCHCCloudCourse100802:10-07-26_Workload_Mode_Job_Scheduling.pdf 3-2] || || ||
|| 7/30 || Theory || Workload Model, Job Scheduling,[[BR]] and Resource Allocation || 台中教育大學資科系[[BR]][http://www.ntcu.edu.tw/kchuang/ 黃國展 助理教授][[BR]]Prof. Kuo-Chan Huang || [raw-attachment:wiki:NCHCCloudCourse100802:10-07-26_Workload_Mode_Job_Scheduling.pdf 3-3] || || Exam 3 ||
|| 8/02 || Skills || - Build Your Private Cloud with Open Source[[BR]]- Introduction to Hadoop : History and Terminology || 國網中心軟體技術組[[BR]]王耀聰 副研究員[[BR]][http://tw.linkedin.com/in/jazzwang Jazz Yao-Tsung Wang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-08-02_1_Open_Source_Private_Cloud.pdf 4-1][[BR]][raw-attachment:wiki:NCHCCloudCourse100802:10-08-02_2_Hadoop_History_Terminology.pdf 4-2] || || - [raw-attachment:wiki:NCHCCloudCourse100802:10-08-02_Hadoop_4pages.pdf 四頁列印版/4 pages] ||
|| 8/04 || Hands-on || - Introduction to HDFS[[BR]]- Hadoop Installation: presudo mode || 國網中心軟體技術組[[BR]]王耀聰 副研究員[[BR]][http://tw.linkedin.com/in/jazzwang Jazz Yao-Tsung Wang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-08-04_1_HDFS.pdf 4-3] || [wiki:NCHCCloudCourse100802/Lab1 Lab1][[BR]][wiki:NCHCCloudCourse100802/Lab2 Lab2] || @ '''PC Room C''' ||
|| 8/06 || Hands-on || - Introduction to MapReduce[[BR]]- MapReduce Programing 101[[BR]]- Introduction to Clonezilla || 國網中心軟體技術組[[BR]]王耀聰 副研究員[[BR]][http://tw.linkedin.com/in/jazzwang Jazz Yao-Tsung Wang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-08-06_MapReduce.pdf 4-4][[BR]][http://speeches.ofset.org/steven/rmll2010/Clonezilla-LSM2010-V3.pdf 4-5] || [wiki:NCHCCloudCourse100802/Lab3 Lab3][[BR]][wiki:NCHCCloudCourse100802/Lab4 Lab4] || @ '''PC Room B''' ||
|| 8/09 || Hands-on || - Hadoop Fully Distributed Mode[[BR]]- Hadoop Deployment Tool : !SmartFog and DRBL || 國網中心軟體技術組[[BR]]王耀聰 副研究員[[BR]][http://tw.linkedin.com/in/jazzwang Jazz Yao-Tsung Wang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-08-09_Hadoop_Cluster.pdf 4-6] || [wiki:NCHCCloudCourse100802/Lab5 Lab5] || @ '''PC Room B''' ||
|| 8/11 || Skills || - Hadoop Ecosystem : HBase, Pig and Streaming || 國網中心軟體技術組[[BR]]王耀聰 副研究員[[BR]][http://tw.linkedin.com/in/jazzwang Jazz Yao-Tsung Wang] || [raw-attachment:wiki:NCHCCloudCourse100802:10-08-11_Hadoop_Ecosystem.pdf 4-7] || [wiki:NCHCCloudCourse100802/Demo1 Demo1] || [wiki:NCHCCloudCourse100802#HW3 HW3] ||
|| 8/13 || Application || - Opportunities and challenges for large-scale data collections [[BR]] - Introduction to photo/video representations || 台大資工系[[BR]][http://www.csie.ntu.edu.tw/people/bio.php?PID=55 徐宏民 助理教授][[BR]][http://www.csie.ntu.edu.tw/~winston/ Prof. Winston H. Hsu] || || || ||
|| 8/16 || Application || - Multimodal image similarities [[BR]] - Graph construction, clustering, and learning || 台大資工系[[BR]][http://www.csie.ntu.edu.tw/people/bio.php?PID=55 徐宏民 助理教授][[BR]][http://www.csie.ntu.edu.tw/~winston/ Prof. Winston H. Hsu] || || || ||
|| 8/18 || Application || - Data warehousing [[BR]] - Clustering algorithms || 台大資工系[[BR]][http://www.csie.ntu.edu.tw/people/bio.php?PID=55 徐宏民 助理教授][[BR]][http://www.csie.ntu.edu.tw/~winston/ Prof. Winston H. Hsu] || || || ||
|| 8/20 || Application || - Visual semantic analysis [[BR]]- Machine learning algorithms || 台大資工系[[BR]][http://www.csie.ntu.edu.tw/people/bio.php?PID=55 徐宏民 助理教授][[BR]][http://www.csie.ntu.edu.tw/~winston/ Prof. Winston H. Hsu] || || || [wiki:NCHCCloudCourse100802#HW4 HW4] ||
= HW1 =
[[Image(hw1.png,width=400)]]
= HW2-1 =
[[Image(hw2-1.png,width=800)]]
= HW2-2 =
[[Image(hw2-2.png,width=800)]]
= HW3 =
* Due: __'''2010/08/20 (Fri.)'''__
* Try to run hadoop streaming job on http://hadoop.nchc.org.tw
* Mapper: /bin/cat
* Reducer: /usr/bin/wc
* Input: /etc/hadoop/conf
* Output: /user/${id}/output
* Run with extra parameter with -numReduceTasks
* Please take screenshot of both results and compare the results. Compare the time of 1 reducer with 8 reducers.
* Send a report of this homework to jazz_AT_nchc_DOT_org_DOT_tw
= HW4 =
* The goal for the assignment is to exercise the MapReduce implementation for constructing inverted file indexing from the small set of (nine) documents. The document id is at the first number.
* data could be download from [raw-attachment:wiki:NCHCCloudCourse100802:data.zip here].
* The due is on __'''August 27, Friday'''__.
* Please send the source code and the output to the lecturer winston AT csie DOT ntu DOT edu DOT tw