close
Warning:
Can't synchronize with repository "(default)" (Unsupported version control system "svn": /usr/lib/python2.7/dist-packages/libsvn/_fs.so: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.
- Timestamp:
-
Apr 26, 2010, 6:52:42 PM (14 years ago)
- Author:
-
waue
- Comment:
-
--
Legend:
- Unmodified
- Added
- Removed
- Modified
-
v23
|
v24
|
|
12 | 12 | |
13 | 13 | {{{ |
14 | | $ bin/hadoop jar contrib/streaming/hadoop-0.18.3-streaming.jar \ |
| 14 | $ bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar \ |
15 | 15 | -input $INPUT -output $OUTPUT -mapper $MAPPER -reducer $REDUCER |
16 | 16 | }}} |
… |
… |
|
19 | 19 | |
20 | 20 | || bin/hadoop || 呼叫使用hadoop程式 || || |
21 | | || jar contrib/streaming/hadoop-0.18.3-streaming.jar || 使用streaming這個功能 || ps:預設此jar檔放在 contrib/streaming/ 內 || |
| 21 | || jar contrib/streaming/hadoop-0.20.2-streaming.jar || 使用streaming這個功能 || ps:預設此jar檔放在 contrib/streaming/ 內 || |
22 | 22 | || -input $INPUT || 設定hdfs上的輸入資料夾 || ps:需先上傳資料到hdfs 上 || |
23 | 23 | || -output $OUTPUT || 設定hdfs上的輸出資料夾|| ps:在hdfs 上的 output資料夾不可重複|| |
… |
… |
|
34 | 34 | |
35 | 35 | {{{ |
36 | | $ bin/hadoop jar contrib/streaming/hadoop-0.18.3-streaming.jar \ |
| 36 | $ bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar \ |
37 | 37 | -input lab4_input -output stream-out1 -mapper /bin/cat -reducer /usr/bin/wc |
38 | 38 | }}} |
… |
… |
|
145 | 145 | |
146 | 146 | {{{ |
147 | | $ bin/hadoop jar contrib/streaming/hadoop-0.18.3-streaming.jar \ |
| 147 | $ bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar \ |
148 | 148 | -mapper /opt/hadoop/mapper.php -reducer /opt/hadoop/reducer.php -input lab4_input -output stream_out2 |
149 | 149 | }}} |