= 2012-10-24 = == Hadoop World 2012 == * '''Big Answers''' - Mike Olson (Cloudera) * http://cloudera.com/impla - Apache License , Realtime Query Engine * Application : Agriculture , Social Security * '''The End of the Data Warehouse''' - Ben Werther (Platfora) * Add Datawarehouse between Web Interface and Hadoop * In-Memory BI * '''Moneyball for New York City''' - Michael Flowers (NYC Mayor's Office of Policy and Strategic Planning) * Introduce "Data Sensing Lab" in the venue. (based on Arduino) * '''Smart City''' - How to use NYC data more effectively * Fire Risk Inspection Analytic - 預測火災的風險有多高 -> 有效地降低了 * 25 Years old staff , Start on 2005 PCs and MS Excel * Use Web (Wall) for collaberation editing * Grow and Enable Culture of Data-driven * '''Thinking Big Together: Driving the Future of Data Science''' - Annika Jimenez (EMC Greenplum), Anthony Goldbloom (Kaggle) * Data, Technology, Application, Data Science * http://openchorus.org * Kaggle - in short of professional exprt - 每次會議都會說公司在徵才,也代表這個領域的人才缺乏。 * http://greenplum.com/communities * '''The Composite Database''' - Rich Hickey (Datomic) * Big Data 雜誌 - * Strata - 9:1 -> 投稿:接受 * breakdown tranditional database : storage, index, query * Indexing as a component : Storage -> Indexing -> Ordered Storage * Uqery as a component : * Coordination as component * Other component : notification, memory indexes (liveness), caching * '''The Democratization of Big Data: Bringing Hadoop to the Masses''' - James Markarian (Informatica) * 用分子表示是說明 Hadoop Ecosystem 的關聯性 * coding model work, but hadoop ecosystem need a friendly interface * '''Big Data Direct – The Era of Self-driven Big Data Exploration Sharmila''' - Shahani-Mulligan (ClearStory Data) * Ever-increasing complexity of sources - growing open data api - 資料的複雜度(complexity)愈來愈高 * 混合 private data 與 public data 可以得到許多洞見(insight) - 舉了不同的案例(Ex. 水管, Web Site SEO) * $35 billion industry for databases and data containers * Future : new era to analyze big data easilly and balance it with judgment and experience * Solution Must Aid Human Insight - Big Data + Amplified Human Intelligence * Next Generation Visualization - Only One Part of the Answer ( 一張圖也只是為了解釋某個答案的一部份) * '''Bringing the 'So What' to Big Data''' - Tim Estes (Digital Reasoning) * Machine Reading problem * It's about People understanding data to change and impove their lives * Big understanding > Big Data * Key : Machine Learning , Bare Metal, Application * People > Data * Ex. 支持國家安全的分析, 確保自由。 * Ex. 從廣告找出人蛇集團,拯救未成年少女被綁架。 * Ex. 降低金融風險 * Mission > Consumerism * Three Key mission: (1) Security and Freedom of World (2) (3)