Changes between Version 8 and Version 9 of jazz/Hadoop_Lab2


Ignore:
Timestamp:
Mar 24, 2009, 11:57:54 AM (16 years ago)
Author:
waue
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • jazz/Hadoop_Lab2

    v8 v9  
    4343 請參考 [http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/package-summary.html org.apache.hadoop.examples]
    4444 
    45 
    46  
    4745{{{
    4846#!html
    … …  
    7977<tr class="TableRowColor" bgcolor="white">
    8078<td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/Join.html" title="class in org.apache.hadoop.examples">Join</a></b></td>
    81 <td>This is the trivial map/reduce program that does absolutely nothing
    82  other than use the framework to fragment and sort the input values.</td>
     79<td>This is the trivial map/reduce program that does absolutely nothing other than use the framework to fragment and sort the input values. To run: bin/hadoop jar build/hadoop-examples.jar join [-m maps] [-r reduces] [-inFormat input format class] [-outFormat output format class] [-outKey output key class] [-outValue output value class] [-joinOp <inner|outer|override>] [in-dir]* in-dir out-dir</td>
    8380</tr>
    84 <tr class="TableRowColor" bgcolor="white">
    85 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/MultiFileWordCount.html" title="class in org.apache.hadoop.examples">MultiFileWordCount</a></b></td>
    86 <td>MultiFileWordCount is an example to demonstrate the usage of
    87  MultiFileInputFormat.</td>
    88 </tr>
    89 <tr class="TableRowColor" bgcolor="white">
    90 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/MultiFileWordCount.MapClass.html" title="class in org.apache.hadoop.examples">MultiFileWordCount.MapClass</a></b></td>
    9181
    92 <td>This Mapper is similar to the one in <a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/WordCount.MapClass.html" title="class in org.apache.hadoop.examples"><code>WordCount.MapClass</code></a>.</td>
    93 </tr>
    94 <tr class="TableRowColor" bgcolor="white">
    95 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/MultiFileWordCount.MultiFileLineRecordReader.html" title="class in org.apache.hadoop.examples">MultiFileWordCount.MultiFileLineRecordReader</a></b></td>
    96 <td>RecordReader is responsible from extracting records from the InputSplit.</td>
    97 </tr>
    98 <tr class="TableRowColor" bgcolor="white">
    99 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/MultiFileWordCount.MyInputFormat.html" title="class in org.apache.hadoop.examples">MultiFileWordCount.MyInputFormat</a></b></td>
    100 <td>To use <a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/mapred/MultiFileInputFormat.html" title="class in org.apache.hadoop.mapred"><code>MultiFileInputFormat</code></a>, one should extend it, to return a
    101  (custom) <a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/mapred/RecordReader.html" title="interface in org.apache.hadoop.mapred"><code>RecordReader</code></a>.</td>
    102 
    103 </tr>
    104 <tr class="TableRowColor" bgcolor="white">
    105 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/MultiFileWordCount.WordOffset.html" title="class in org.apache.hadoop.examples">MultiFileWordCount.WordOffset</a></b></td>
    106 <td>This record keeps &lt;filename,offset&gt; pairs.</td>
    107 </tr>
    108 <tr class="TableRowColor" bgcolor="white">
    109 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/PiEstimator.html" title="class in org.apache.hadoop.examples">PiEstimator</a></b></td>
    110 <td>A Map-reduce program to estimaate the valu eof Pi using monte-carlo
    111  method.</td>
    112 </tr>
    113 <tr class="TableRowColor" bgcolor="white">
    114 
    115 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/PiEstimator.PiMapper.html" title="class in org.apache.hadoop.examples">PiEstimator.PiMapper</a></b></td>
    116 <td>Mappper class for Pi estimation.</td>
    117 </tr>SleepJob.SleepInputFormat
    11882<tr class="TableRowColor" bgcolor="white">
    11983<td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/RandomTextWriter.html" title="class in org.apache.hadoop.examples">RandomTextWriter</a></b></td>
    12084<td>This program uses map/reduce to just run a distributed job where there is
    12185 no interaction between the tasks and each task writes a large unsorted
    122  random sequence of words.</td>
     86 random sequence of words.To run: bin/hadoop jar hadoop-${version}-examples.jar randomtextwriter [-outFormat output format class] output</td>
    12387</tr>
     88
    12489<tr class="TableRowColor" bgcolor="white">
    125 
    12690<td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/RandomWriter.html" title="class in org.apache.hadoop.examples">RandomWriter</a></b></td>
    12791<td>This program uses map/reduce to just run a distributed job where there is
    12892 no interaction between the tasks and each task write a large unsorted
    129  random binary sequence file of BytesWritable.</td>
    130 </tr>
    131 <tr class="TableRowColor" bgcolor="white">
    132 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/SleepJob.html" title="class in org.apache.hadoop.examples">SleepJob</a></b></td>
    133 <td>Dummy class for testing MR framefork.</td>
     93 random binary sequence file of BytesWritable.To run: bin/hadoop jar hadoop-${version}-examples.jar randomwriter [-outFormat output format class] output</td>
    13494</tr>
    13595
    … …  
    13797<td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/Sort.html" title="class in org.apache.hadoop.examples">Sort&lt;K,V&gt;</a></b></td>
    13898<td>This is the trivial map/reduce program that does absolutely nothing
    139  other than use the framework to fragment and sort the input values.</td>
     99 other than use the framework to fragment and sort the input values.To run: bin/hadoop jar build/hadoop-examples.jar sort [-m maps] [-r reduces] [-inFormat input format class] [-outFormat output format class] [-outKey output key class] [-outValue output value class] [-totalOrder pcnt num samples max splits] in-dir out-dir</td>
    140100</tr>
     101
    141102<tr class="TableRowColor" bgcolor="white">
    142103<td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/WordCount.html" title="class in org.apache.hadoop.examples">WordCount</a></b></td>
    … …  
    144105</tr>
    145106
    146 <tr class="TableRowColor" bgcolor="white">
    147 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/WordCount.MapClass.html" title="class in org.apache.hadoop.examples">WordCount.MapClass</a></b></td>
    148 <td>Counts the words in each line.</td>
    149 </tr>
    150 <tr class="TableRowColor" bgcolor="white">
    151 <td width="15%"><b><a href="http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/WordCount.Reduce.html" title="class in org.apache.hadoop.examples">WordCount.Reduce</a></b></td>
    152 <td>A reducer class that just emits the sum of the input values.</td>
    153 </tr>
    154107</tbody></table>
    155108&nbsp;
    156109}}}
    157  
    158110 
    159111 == Content 3. 使用網頁Gui瀏覽訊息 ==