close Warning: Can't synchronize with repository "(default)" (Unsupported version control system "svn": /usr/lib/python2.7/dist-packages/libsvn/_fs.so: failed to map segment from shared object: Cannot allocate memory). Look in the Trac log for more information.

Changes between Version 14 and Version 15 of jazz/13-06-02


Ignore:
Timestamp:
Jun 2, 2013, 10:24:39 AM (13 years ago)
Author:
jazz
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • jazz/13-06-02

    v14 v15  
    2121   - Sandbox Report - 1.2M reports / 2.4TB / Hadoop
    2222   - PAFI ( virus scan results ) - 50M reports / 514 GB / HBase
    23    - Census (?)
     23   - Census (? 300GB)
    2424   - Sandbox VM - Windows (?) - pcap (network packet) / screenshot - 8GB/day, 3000 malware - 存在 HDFS
    25    - Similarity Search
    26    - 將 log 透過 MR Job 或 Pig 存成 Lucene Index (?)，再匯入 Solr
     25   - Similarity Search 相似度搜尋
     26   - 將 log 透過 MR Job 或 Pig 存成 Lucene Index (?)，再匯入 Solr (Index Size: 6GB)，
     27　　- incremental data update (?) → incremental index update