Changes between Initial Version and Version 1 of NCHCCloudCourse100802/Demo1


Ignore:
Timestamp:
Aug 11, 2010, 12:38:03 AM (14 years ago)
Author:
jazz
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • NCHCCloudCourse100802/Demo1

    v1 v1  
     1
     2== Hadoop Streaming with commands ==
     3
     4{{{
     5jazz@hadoop:~$ echo "sed -e \"s/ /\n/g\" | grep ." > streamingMapper.sh
     6jazz@hadoop:~$ echo "uniq -c | awk '{print $2 \"\t\" $1}'" > streamingReducer.sh
     7jazz@hadoop:~$ hadoop fs -put /etc/hadoop/conf input
     8jazz@hadoop:~$ hadoop jar hadoop-streaming.jar -input input -output output -mapper `pwd`/streamingMapper.sh -reducer `pwd`/streamingReducer.sh
     9}}}