close Warning: Can't synchronize with repository "(default)" (Unsupported version control system "svn": /usr/lib/python2.7/dist-packages/libsvn/_repos.so: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.

Changes between Version 1 and Version 2 of III140412/Lab20


Ignore:
Timestamp:
Apr 11, 2014, 11:32:07 PM (12 years ago)
Author:
jazz
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • III140412/Lab20

    v1 v2  
    1818 * 官方實作的 !TextInputFormat.java 有兩個(一個新版,一個舊版)
    1919{{{
    20 lab@node1:~$ find /home/user/hadoop/src/ -name "TextInputFormat.java"
    21 /home/user/hadoop/src/mapred/org/apache/hadoop/mapreduce/lib/input/TextInputFormat.java
    22 /home/user/hadoop/src/mapred/org/apache/hadoop/mapred/TextInputFormat.java
     20lab@node1:~$ find /home/$USER/hadoop/src/ -name "TextInputFormat.java"
     21/home/$USER/hadoop/src/mapred/org/apache/hadoop/mapreduce/lib/input/TextInputFormat.java
     22/home/$USER/hadoop/src/mapred/org/apache/hadoop/mapred/TextInputFormat.java
    2323}}}
    2424 * 這裡我們修改新版的 !TextInputFormat.java
    2525{{{
    2626#!diff
    27 --- /home/user/hadoop/src/mapred/org/apache/hadoop/mapreduce/lib/input/TextInputFormat.java   2012-10-03 13:17:16.000000000 +0800
    28 +++ /home/user/hadoop_labs/lab011/src/TextInputFormat.java      2013-10-19 11:25:16.419320587 +0800
     27--- /home/$USER/hadoop/src/mapred/org/apache/hadoop/mapreduce/lib/input/TextInputFormat.java   2012-10-03 13:17:16.000000000 +0800
     28+++ /home/$USER/hadoop_labs/lab011/src/TextInputFormat.java      2013-10-19 11:25:16.419320587 +0800
    2929@@ -38,11 +38,13 @@
    3030   public RecordReader<LongWritable, Text>
    … …  
    5858}}}
    5959
    60  *
     60 * 切換到 Local Mode，再執行一次，並觀察有什麼差異。
    6161{{{
    6262export HADOOP_CONF_DIR=~/hadoop/conf.local/