Changes between Version 5 and Version 6 of jazz/demo.crawlzilla.info

Timestamp:

May 11, 2013, 4:29:36 PM (11 years ago)

Author:

jazz

Comment:

--

jazz/demo.crawlzilla.info

@@ -59 +59 @@
                useBodyEncodingForURI="true" />
 }}}
+
+== 2013-05-11 ==
+
+ * 也許因為註冊人數變多了，開始會遇到 Tomcat 記憶體不足的現象。因此做了點小的調整：
+ * 因為 Hadoop 的資源使用量並不大，因此把 hadoop-env.sh 的 HADOOP_HEAPSIZE 調降到 256M - /opt/crawlzilla/nutch/conf/hadoop-env.sh
+{{{
+# The maximum amount of heap to use, in MB. Default is 1000.
+export HADOOP_HEAPSIZE=256
+}}}
+ * 其次，修改 mapred-site.xml 的預設 mapper 個數與 reducer 個數。 - /opt/crawlzilla/nutch/conf/mapred-site.xml
+{{{
+   <property>
+    <name>mapred.tasktracker.map.tasks.maximum</name>
+    <value>6</value>
+    <description>The maximum number of map tasks that will be run
+    simultaneously by a task tracker.
+    </description>
+  </property>
+  <property>
+    <name>mapred.tasktracker.reduce.tasks.maximum</name>
+    <value>2</value>
+    <description>
+    </description>
+  </property>
+}}}
+ * 增加 Tomcat 的 HEAPSIZE 到 4GB - /opt/crawlzilla/tomcat/bin/catalina.sh
+{{{
+case "`uname`" in
+CYGWIN*) cygwin=true;;
+OS400*) os400=true;;
+Darwin*) darwin=true;;
+esac
+
+## Add by Jazz - 2013-05-11
+export CATALINA_OPTS="-Xms1024m -Xmx4096m"
+
+# resolve links - $0 may be a softlink
+PRG="$0"
+}}}