close
Warning:
Can't synchronize with repository "(default)" (Unsupported version control system "svn": /usr/lib/python2.7/dist-packages/libsvn/_fs.so: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.
- Timestamp:
-
Jan 12, 2011, 3:28:17 PM (14 years ago)
- Author:
-
rock
- Comment:
-
--
Legend:
- Unmodified
- Added
- Removed
- Modified
-
v8
|
v9
|
|
10 | 10 | |
11 | 11 | 測試方式: 各別summit job,前一crawl job完成後再執行下一個job,非同時summit全部job |
12 | | |
13 | 12 | 起始位址: http://udn.com/NEWS/mainpage.shtml |
14 | 13 | |
… |
… |
|
35 | 34 | |
36 | 35 | 測試方式: shell script 執行爬取3~10層的Job |
37 | | |
38 | 36 | 起始位址: http://udn.com/NEWS/mainpage.shtml |
39 | 37 | |
… |
… |
|
48 | 46 | ||9|||||||| |
49 | 47 | ||10|||||||| |
| 48 | |
| 49 | == Reference == |
| 50 | * maps & reduces number |
| 51 | * [http://www.ics.uci.edu/~abehm/hadoop.html#how_many_maps_reduces] |