2011-05-12
資安
- http://www.virustotal.com/ - 把檔案放上去做各種掃毒軟體的掃描結果總和
NTU CMLab
- 關於台大 CMLab 的幾個有趣的論文:
- A Collaborative Benchmark for Region of Interest Detection Algorithms
- Tiling Slideshow - Audiovisual Slideshow: Present Your Journey by Photos - 根據音樂節奏、加入相片的特徵分群(依時間、相似度、橫向直向等)、運算重點感興趣的區域、自動套入樣板。蠻有趣的一個研究,對於要把旅行相片或者是婚紗相片變成影片,真是個不錯的工具。可以看展示影片比較有感覺。
Hadoop HDFSProxy
Hadoop
- The Mellanox Solution for Web 2.0 and Big Data - mellanox 用硬體去加速 Hadoop 與 Memcached Mellanox Hadoop-Direct accelerates Hadoop networks and improves the scaling of Hadoop clusters executing data analytics intensive applications. A novel data moving protocol, which uses RDMA in combination with an efficient merge-sort algorithm, enables Hadoop clusters based on Mellanox InfiniBand and 10GbE with RoCE (RDMA over Converged Ethernet) adapter cards to efficiently move data between servers, accelerating the Hadoop framework.
- NetApp e5400 - NetApp 針對 Big Data 應用(Ex. Hadoop)強化 IOPS
- SnapLogic 的 SnapReduce - 這間公司目標想把 Hadoop 變成更簡單,設計了圖形化介面來作 Map/Reduce? 工作的規劃。
- HStack - http://hstack.org/ - 由 Adobe 的人弄的自由軟體專案
- 整合 Hadoop + HBase + ZooKeeper + Puppet
- 程式碼 - https://github.com/hstack/puppet
- HBase Performance Testing
Virtualization
- http://www.linux-kvm.org/page/Management_Tools - KVM 的管理介面
- http://libvirt.org/apps.html - Applications using libvirt - 各種用 libvirt 做的應用,包含管理介面
libvirt & opennebula
- 從 OpenNebula 的 Libvirt API 1.4 文件 可以看到兩者的關聯性。
Data Science
- (2011-04-06)
- Data Science – Part 1
- Data Science – Part 2
- What is data science? - Analysis: The future belongs to the companies and people that turn data into products.
- The Rise of Data Science
R packages & RHIPE & BioConductor
- bigmemory: Manage massive matrices with shared memory and memory-mapped files
- 先前跑 microarray 的時候,容易遇到記憶體上限,這是一個解法。
- http://www.bigmemory.org/
- <官網> RHIPE - R and Hadoop Integrated Processing Environment
- RHIPE combines Hadoop and the R analytics language
- BioC 2010 有 BioConductor 跟 R 的教學,特別是 Efficient R Programming 的部份。
- <書> Data Mashups in R
- <書> Visualize This: The FlowingData Guide to Design, Visualization, and Statistics
reCAPTCHA & phpBB2
Last modified 13 years ago
Last modified on May 17, 2011, 11:27:57 PM
Attachments (2)
- ROI.png (310.0 KB) - added by jazz 13 years ago.
- SnapReduce.png (399.2 KB) - added by jazz 13 years ago.
Download all attachments as: .zip