Changes between Version 8 and Version 9 of crawlzilla/crawl_statistics


Ignore:
Timestamp:
Jan 12, 2011, 3:28:17 PM (14 years ago)
Author:
rock
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • crawlzilla/crawl_statistics

    v8 v9  
    1010
    1111測試方式: 各別summit job，前一crawl job完成後再執行下一個job，非同時summit全部job
    12 
    1312起始位址: http://udn.com/NEWS/mainpage.shtml
    1413
    … …  
    3534
    3635測試方式: shell script 執行爬取3~10層的Job
    37 
    3836起始位址: http://udn.com/NEWS/mainpage.shtml
    3937
    … …  
    4846||9||||||||
    4947||10||||||||
     48
     49== Reference ==
     50 * maps & reduces number
     51   * [http://www.ics.uci.edu/~abehm/hadoop.html#how_many_maps_reduces]