Changes between Version 1 and Version 2 of jazz/Hadoop_Lab2


Ignore:
Timestamp:
Mar 24, 2009, 11:08:36 AM (15 years ago)
Author:
waue
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • jazz/Hadoop_Lab2

    v1 v2  
    2323 請參考 [http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/examples/package-summary.html org.apache.hadoop.examples]
    2424 
    25  || || ||
    26  || AggregateWordCount  ||      This is an example Aggregated Hadoop Map/Reduce application. ||
    27  || AggregateWordCount.WordCountPlugInClass  ||  ||     
    28  || AggregateWordHistogram  ||  This is an example Aggregated Hadoop Map/Reduce application. ||
    29  || AggregateWordHistogram.AggregateWordHistogramPlugin          ||  || 
    30  || DBCountPageView  ||         This is a demonstrative program, which uses DBInputFormat for reading the input data from a database, and DBOutputFormat for writing the data to the database. ||
    31  || ExampleDriver  ||   A description of an example program based on its class and a human-readable description. ||
    32  || Grep          ||  ||
    33  || Join  ||    This is the trivial map/reduce program that does absolutely nothing other than use the framework to fragment and sort the input values. ||
    34  || MultiFileWordCount  ||      MultiFileWordCount is an example to demonstrate the usage of MultiFileInputFormat. ||
    35  || MultiFileWordCount.MapClass          || This Mapper is similar to the one in WordCount.MapClass. ||
    36  || MultiFileWordCount.MultiFileLineRecordReader  ||    RecordReader is responsible from extracting records from the InputSplit. ||
    37  || MultiFileWordCount.MyInputFormat  ||        To use MultiFileInputFormat, one should extend it, to return a (custom) RecordReader. ||
    38  || MultiFileWordCount.WordOffset  ||   This record keeps <filename,offset> pairs. ||
    39  || PiEstimator  ||     A Map-reduce program to estimaate the valu eof Pi using monte-carlo method. ||
    40  || PiEstimator.PiMapper  ||    Mappper class for Pi estimation.
    41 PiEstimator.PiReducer     ||
    42  || RandomTextWriter     || This program uses map/reduce to just run a distributed job where there is no interaction between the tasks and each task writes a large unsorted random sequence of words. ||
    43  || RandomWriter  ||    This program uses map/reduce to just run a distributed job where there is no interaction between the tasks and each task write a large unsorted random binary sequence file of BytesWritable. ||
    44  || SleepJob  ||        Dummy class for testing MR framefork. ||
    45  || Sort<K,V>  ||       This is the trivial map/reduce program that does absolutely nothing other than use the framework to fragment and sort the input values. ||
    46  || WordCount  ||       This is an example Hadoop Map/Reduce application. ||
    47  || WordCount.MapClass  ||      Counts the words in each line. ||
    48  || WordCount.Reduce  ||        A reducer class that just emits the sum of the input values. ||
    49    
     25{{{
     26#!html
     27</a>
     28</p><p>
     29
     30</p><table summary="" border="1" cellpadding="3" cellspacing="0" width="100%">
     31<tbody><tr class="TableHeadingColor" bgcolor="#ccccff">
     32<th colspan="2" align="left"><font size="+2">
     33<b>Class Summary</b></font></th>
     34</tr>
     35<tr class="TableRowColor" bgcolor="white">
     36<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/AggregateWordCount.html" title="class in org.apache.hadoop.examples">AggregateWordCount</a></b></td>
     37
     38<td>This is an example Aggregated Hadoop Map/Reduce application.</td>
     39</tr>
     40<tr class="TableRowColor" bgcolor="white">
     41<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/AggregateWordCount.WordCountPlugInClass.html" title="class in org.apache.hadoop.examples">AggregateWordCount.WordCountPlugInClass</a></b></td>
     42<td>&nbsp;</td>
     43</tr>
     44<tr class="TableRowColor" bgcolor="white">
     45<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/AggregateWordHistogram.html" title="class in org.apache.hadoop.examples">AggregateWordHistogram</a></b></td>
     46<td>This is an example Aggregated Hadoop Map/Reduce application.</td>
     47</tr>
     48<tr class="TableRowColor" bgcolor="white">
     49<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/AggregateWordHistogram.AggregateWordHistogramPlugin.html" title="class in org.apache.hadoop.examples">AggregateWordHistogram.AggregateWordHistogramPlugin</a></b></td>
     50
     51<td>&nbsp;</td>
     52</tr>
     53<tr class="TableRowColor" bgcolor="white">
     54<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/DBCountPageView.html" title="class in org.apache.hadoop.examples">DBCountPageView</a></b></td>
     55<td>This is a demonstrative program, which uses DBInputFormat for reading
     56 the input data from a database, and DBOutputFormat for writing the data
     57 to the database.</td>
     58</tr>
     59<tr class="TableRowColor" bgcolor="white">
     60<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/ExampleDriver.html" title="class in org.apache.hadoop.examples">ExampleDriver</a></b></td>
     61<td>A description of an example program based on its class and a
     62 human-readable description.</td>
     63</tr>
     64<tr class="TableRowColor" bgcolor="white">
     65<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/Grep.html" title="class in org.apache.hadoop.examples">Grep</a></b></td>
     66
     67<td>&nbsp;</td>
     68</tr>
     69<tr class="TableRowColor" bgcolor="white">
     70<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/Join.html" title="class in org.apache.hadoop.examples">Join</a></b></td>
     71<td>This is the trivial map/reduce program that does absolutely nothing
     72 other than use the framework to fragment and sort the input values.</td>
     73</tr>
     74<tr class="TableRowColor" bgcolor="white">
     75<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/MultiFileWordCount.html" title="class in org.apache.hadoop.examples">MultiFileWordCount</a></b></td>
     76<td>MultiFileWordCount is an example to demonstrate the usage of
     77 MultiFileInputFormat.</td>
     78</tr>
     79<tr class="TableRowColor" bgcolor="white">
     80<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/MultiFileWordCount.MapClass.html" title="class in org.apache.hadoop.examples">MultiFileWordCount.MapClass</a></b></td>
     81
     82<td>This Mapper is similar to the one in <a href="../../../../org/apache/hadoop/examples/WordCount.MapClass.html" title="class in org.apache.hadoop.examples"><code>WordCount.MapClass</code></a>.</td>
     83</tr>
     84<tr class="TableRowColor" bgcolor="white">
     85<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/MultiFileWordCount.MultiFileLineRecordReader.html" title="class in org.apache.hadoop.examples">MultiFileWordCount.MultiFileLineRecordReader</a></b></td>
     86<td>RecordReader is responsible from extracting records from the InputSplit.</td>
     87</tr>
     88<tr class="TableRowColor" bgcolor="white">
     89<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/MultiFileWordCount.MyInputFormat.html" title="class in org.apache.hadoop.examples">MultiFileWordCount.MyInputFormat</a></b></td>
     90<td>To use <a href="../../../../org/apache/hadoop/mapred/MultiFileInputFormat.html" title="class in org.apache.hadoop.mapred"><code>MultiFileInputFormat</code></a>, one should extend it, to return a
     91 (custom) <a href="../../../../org/apache/hadoop/mapred/RecordReader.html" title="interface in org.apache.hadoop.mapred"><code>RecordReader</code></a>.</td>
     92
     93</tr>
     94<tr class="TableRowColor" bgcolor="white">
     95<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/MultiFileWordCount.WordOffset.html" title="class in org.apache.hadoop.examples">MultiFileWordCount.WordOffset</a></b></td>
     96<td>This record keeps &lt;filename,offset&gt; pairs.</td>
     97</tr>
     98<tr class="TableRowColor" bgcolor="white">
     99<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/PiEstimator.html" title="class in org.apache.hadoop.examples">PiEstimator</a></b></td>
     100<td>A Map-reduce program to estimaate the valu eof Pi using monte-carlo
     101 method.</td>
     102</tr>
     103<tr class="TableRowColor" bgcolor="white">
     104
     105<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/PiEstimator.PiMapper.html" title="class in org.apache.hadoop.examples">PiEstimator.PiMapper</a></b></td>
     106<td>Mappper class for Pi estimation.</td>
     107</tr>
     108<tr class="TableRowColor" bgcolor="white">
     109<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/PiEstimator.PiReducer.html" title="class in org.apache.hadoop.examples">PiEstimator.PiReducer</a></b></td>
     110<td>&nbsp;</td>
     111</tr>
     112<tr class="TableRowColor" bgcolor="white">
     113<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/RandomTextWriter.html" title="class in org.apache.hadoop.examples">RandomTextWriter</a></b></td>
     114<td>This program uses map/reduce to just run a distributed job where there is
     115 no interaction between the tasks and each task writes a large unsorted
     116 random sequence of words.</td>
     117</tr>
     118<tr class="TableRowColor" bgcolor="white">
     119
     120<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/RandomWriter.html" title="class in org.apache.hadoop.examples">RandomWriter</a></b></td>
     121<td>This program uses map/reduce to just run a distributed job where there is
     122 no interaction between the tasks and each task write a large unsorted
     123 random binary sequence file of BytesWritable.</td>
     124</tr>
     125<tr class="TableRowColor" bgcolor="white">
     126<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/SleepJob.html" title="class in org.apache.hadoop.examples">SleepJob</a></b></td>
     127<td>Dummy class for testing MR framefork.</td>
     128</tr>
     129<tr class="TableRowColor" bgcolor="white">
     130<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/SleepJob.EmptySplit.html" title="class in org.apache.hadoop.examples">SleepJob.EmptySplit</a></b></td>
     131<td>&nbsp;</td>
     132</tr>
     133<tr class="TableRowColor" bgcolor="white">
     134
     135<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/SleepJob.SleepInputFormat.html" title="class in org.apache.hadoop.examples">SleepJob.SleepInputFormat</a></b></td>
     136<td>&nbsp;</td>
     137</tr>
     138<tr class="TableRowColor" bgcolor="white">
     139<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/Sort.html" title="class in org.apache.hadoop.examples">Sort&lt;K,V&gt;</a></b></td>
     140<td>This is the trivial map/reduce program that does absolutely nothing
     141 other than use the framework to fragment and sort the input values.</td>
     142</tr>
     143<tr class="TableRowColor" bgcolor="white">
     144<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/WordCount.html" title="class in org.apache.hadoop.examples">WordCount</a></b></td>
     145<td>This is an example Hadoop Map/Reduce application.</td>
     146</tr>
     147
     148<tr class="TableRowColor" bgcolor="white">
     149<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/WordCount.MapClass.html" title="class in org.apache.hadoop.examples">WordCount.MapClass</a></b></td>
     150<td>Counts the words in each line.</td>
     151</tr>
     152<tr class="TableRowColor" bgcolor="white">
     153<td width="15%"><b><a href="../../../../org/apache/hadoop/examples/WordCount.Reduce.html" title="class in org.apache.hadoop.examples">WordCount.Reduce</a></b></td>
     154<td>A reducer class that just emits the sum of the input values.</td>
     155</tr>
     156</tbody></table>
     157&nbsp;
     158}}}
    50159 
    51  == Content 6. 使用網頁Gui ==
     160 
     161 == Content 3. 使用網頁Gui瀏覽訊息==
     162 
    52163 
    53164 == 練習 ==