Changes between Version 2 and Version 3 of crawlzilla/crawl_statistics


Ignore:
Timestamp:
Jan 12, 2011, 11:12:42 AM (14 years ago)
Author:
shunfa
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • crawlzilla/crawl_statistics

    v2 v3  
    11= Crawlzilla爬取數據參考 =
    22
     3== 單機測試 ==
    34主機資訊   
    45
    … …  
    2930||9||9.3||28044||413921||
    3031||10||9.44||31981||431790||
     32
     33== 叢集測試 ==
     34
     35主機資訊   
     36
     37CPU:
     38
     39記憶體: 8GiB
     40
     41作業系統:
     42
     43Ubuntu 10.04(lucid)
     44
     45Linux Kernel:
     46
     47Cralzilla版本: 0.3.0-101116
     48
     49測試方式: shell script 執行爬取3~10層的Job
     50
     51起始位址: http://udn.com/NEWS/mainpage.shtml
     52
     53測試結果
     54||Depth||Exec. Time(HR)||Crawl Files||Crawl Words||
     55||3||||||||
     56||4||||||||
     57||5||||||||
     58||6||||||||
     59||7||||||||
     60||8||||||||
     61||9||||||||
     62||10||||||||