2012-10-24

Hadoop World 2012

• Big Answers - Mike Olson (Cloudera)
  • ​http://cloudera.com/impla - Apache License , Realtime Query Engine
  • Application : Agriculture , Social Security
• The End of the Data Warehouse - Ben Werther (Platfora)
  • Add Datawarehouse between Web Interface and Hadoop
  • In-Memory BI
• Moneyball for New York City - Michael Flowers (NYC Mayor's Office of Policy and Strategic Planning)
  • Introduce "Data Sensing Lab" in the venue. (based on Arduino)
  • Smart City - How to use NYC data more effectively
  • Fire Risk Inspection Analytic - 預測火災的風險有多高 -> 有效地降低了
  • 25 Years old staff , Start on 2005 PCs and MS Excel
  • Use Web (Wall) for collaberation editing
  • Grow and Enable Culture of Data-driven
• Thinking Big Together: Driving the Future of Data Science - Annika Jimenez (EMC Greenplum), Anthony Goldbloom (Kaggle)
  • Data, Technology, Application, Data Science
  • ​http://openchorus.org
  • Kaggle - in short of professional exprt - 每次會議都會說公司在徵才，也代表這個領域的人才缺乏。
  • ​http://greenplum.com/communities
• The Composite Database - Rich Hickey (Datomic)
  • Big Data 雜誌 -
  • Strata - 9:1 -> 投稿:接受
  • breakdown tranditional database : storage, index, query
  • Indexing as a component : Storage -> Indexing -> Ordered Storage
  • Uqery as a component :
  • Coordination as component
  • Other component : notification, memory indexes (liveness), caching
• The Democratization of Big Data: Bringing Hadoop to the Masses - James Markarian (Informatica)
  • 用分子表示是說明 Hadoop Ecosystem 的關聯性
  • coding model work, but hadoop ecosystem need a friendly interface
• Big Data Direct – The Era of Self-driven Big Data Exploration Sharmila - Shahani-Mulligan (ClearStory? Data)
  • Ever-increasing complexity of sources - growing open data api - 資料的複雜度(complexity)愈來愈高
  • 混合 private data 與 public data 可以得到許多洞見(insight) - 舉了不同的案例(Ex. 水管, Web Site SEO)
  • $35 billion industry for databases and data containers
  • Future : new era to analyze big data easilly and balance it with judgment and experience
  • Solution Must Aid Human Insight - Big Data + Amplified Human Intelligence
  • Next Generation Visualization - Only One Part of the Answer ( 一張圖也只是為了解釋某個答案的一部份)
• Bringing the 'So What' to Big Data - Tim Estes (Digital Reasoning)
  • Machine Reading problem
  • It's about People understanding data to change and impove their lives
  • Big understanding > Big Data
  • Key : Machine Learning , Bare Metal, Application
  • People > Data
  • Ex. 支持國家安全的分析, 確保自由。
  • Ex. 從廣告找出人蛇集團，拯救未成年少女被綁架。