Changes between Version 4 and Version 5 of jazz/10-06-21

Timestamp:

Jun 21, 2010, 6:20:09 PM (14 years ago)

Author:

jazz

Comment:

--

jazz/10-06-21

@@ -1 +1 @@
 = 2010-06-21 =
-
-{{{
-#!graphviz
-digraph cloud_stack { size="16,10"; node[shape=box,width=2.0];
-   "Crawlers" -> "HTML files stored in Google File System" -> "Map/Reduce Job to analysis keywords into index" -> "(search keyword, URLs) key-value pairs stored in BigTable";
-}
-}}}
 
 == Linux ==
@@ -31 +24 @@
 $ rsync --partial --progress --rsh=ssh localfile remotehost:directory/
 }}}
+
+== Hadoop ==
+
+ * 今天在論壇上有人問到如果 google 的查詢索引放在記憶體中，若使用 Hadoop 與 HBase 的邏輯來思考，資料流大概是長這樣：
+{{{
+#!graphviz
+digraph cloud_stack { size="16,10"; node[shape=box,width=2.0];
+   "Crawlers" -> "HTML files stored in Google File System" -> "Map/Reduce Job to analysis keywords into index" -> "(search keyword, URLs) key-value pairs stored in BigTable";
+}
+}}}