2011-05-12

資安

• ​http://www.virustotal.com/ - 把檔案放上去做各種掃毒軟體的掃描結果總和

NTU CMLab

• 關於台大 CMLab 的幾個有趣的論文：
• ​A Collaborative Benchmark for Region of Interest Detection Algorithms
• 
• ​Tiling Slideshow - Audiovisual Slideshow: Present Your Journey by Photos - 根據音樂節奏、加入相片的特徵分群（依時間、相似度、橫向直向等）、運算重點感興趣的區域、自動套入樣板。蠻有趣的一個研究，對於要把旅行相片或者是婚紗相片變成影片，真是個不錯的工具。可以看​展示影片比較有感覺。

Hadoop HDFSProxy

• ​http://hadoop.apache.org/hdfs/docs/r0.21.0/hdfsproxy.html
• 

Hadoop

• ​The Mellanox Solution for Web 2.0 and Big Data - mellanox 用硬體去加速 Hadoop 與 Memcached Mellanox Hadoop-Direct accelerates Hadoop networks and improves the scaling of Hadoop clusters executing data analytics intensive applications. A novel data moving protocol, which uses RDMA in combination with an efficient merge-sort algorithm, enables Hadoop clusters based on Mellanox InfiniBand and 10GbE with RoCE (RDMA over Converged Ethernet) adapter cards to efficiently move data between servers, accelerating the Hadoop framework.

• ​NetApp e5400 - NetApp 針對 Big Data 應用（Ex. Hadoop）強化 IOPS

• ​SnapLogic 的 SnapReduce - 這間公司目標想把 Hadoop 變成更簡單，設計了圖形化介面來作 Map/Reduce? 工作的規劃。
  • ​SnapReduce 的展示影片
  • 

• HStack - ​http://hstack.org/ - 由 Adobe 的人弄的自由軟體專案
  • 整合 Hadoop + HBase + ZooKeeper + Puppet
  • 程式碼 - ​https://github.com/hstack/puppet
  • ​HBase Performance Testing
  • 
  • 

Virtualization

• ​http://www.linux-kvm.org/page/Management_Tools - KVM 的管理介面
• ​http://libvirt.org/apps.html - Applications using libvirt - 各種用 libvirt 做的應用，包含管理介面

libvirt & opennebula

• 
• ​從 OpenNebula 的 Libvirt API 1.4 文件 可以看到兩者的關聯性。

Data Science

• ​Data Science – Part 1
• ​Data Science – Part 2
• ​What is data science? -

Analysis: The future belongs to the companies and people that turn data into products.

• ​The Rise of Data Science

R packages & RHIPE & BioConductor

• ​bigmemory: Manage massive matrices with shared memory and memory-mapped files
  • 先前跑 microarray 的時候，容易遇到記憶體上限，這是一個解法。
  • ​http://www.bigmemory.org/

• <官網> ​RHIPE - R and Hadoop Integrated Processing Environment
• ​RHIPE combines Hadoop and the R analytics language

• ​BioC 2010 有 BioConductor 跟 R 的教學，特別是 Efficient R Programming 的部份。

• <書> ​Data Mashups in R
• <書> ​Visualize This: The FlowingData Guide to Design, Visualization, and Statistics

reCAPTCHA & phpBB2

• ​http://code.google.com/intl/zh-TW/apis/recaptcha/docs/phpbb.html