Changes between Version 14 and Version 15 of crawlzilla-1.0

Timestamp:

Mar 8, 2011, 4:16:35 PM (13 years ago)

Author:

waue

Comment:

--

crawlzilla-1.0

@@ -26 +26 @@
 
  || 目錄1 || 目錄2 || 說明 ||
- || ./user/[admin,username]/ || ./IDB/XXX/meta || admin 為必有資料夾，username 為之後新增的使用者，XXX 為新增索引庫, meta 放每個索引庫的相關檔案 ||
- ||  || ./IDB/XXX/index~segments || index~segments 為 lucene db 的必要五個資料夾||
- ||  || ./tmp || 該使用者正在運算的IndexDB ||
- || ./workspace ||  || hadoop 的運算資料夾 ||
- || ./slave/ ||  || 給 slave 安裝需要的檔案 ||
+ || ./workspace/ ||  || hadoop 的運算資料夾 ||
  || ./meta/ ||  || dialog 產生的中間檔 ||
  || ./meta/tmp/ ||  || 暫存檔 ||
+ || ./user/ ||  || 於後說明 ||
+
+ * /home/crawler/crawlzilla/user 下的目錄格式說明
+
+ || 目錄1 || 目錄2 || 說明 ||
+ || [admin,_username_]/ ||  || admin 為必有資料夾，_username_ 為之後新增的使用者 ||
+ ||  || ./webs/ || 內放搜尋網頁的資料夾  (註1)||
+ ||  || ./webs/_DBName_/ || 名稱為_DBName_的搜尋網頁  ||
+ ||  || ./IDB/ || 內放該使用者已完成的 indexDB 資料夾 ||
+ ||  || ./IDB/_DBName_/ || _DBName_ 為索引庫名稱 ||
+ ||  || ./IDB/_DBName_/meta/ ||  meta 放每個索引庫的相關檔案 ||
+ ||  || ./IDB/_DBName_/index~segments/ || index~segments 為 lucene db 的必要五個資料夾||
+ ||  || ./tmp/ || 內放該使用者未完成的 indexDB 資料夾 ||
+ ||  || ./tmp/_DBName_/ || _DBName_ 為索引庫名稱 ||
+ ||  || ./tmp/_DBName_/meta/ ||  meta 放每個索引庫的相關檔案 ||
+ ||  || ./meta/ || 該使用者的個人資訊，如pwd,email 等 ||
 
  * /opt/crawlzilla/
 
  || 目錄1 || 目錄2 || 說明 ||
- || ./tomcat || ./webapps/UUU/XXX || 對應到 UUU 的 XXX 索引庫 ||
- || ./nutch ||  || nutch 的目錄 ||
+ || ./tomcat/ ||  || tomcat ||
+ || ./tomcat/ || ./webapps/_username_/_DBName_ || 對應到 _username_ 的 _DBName_ 索引庫  （註1）||
+ || ./nutch/ ||  || nutch 的目錄 ||
+ || ./slave/ ||  || 給 slave 安裝需要的檔案 ||
  || ./main/ ||  || 放 crawlzilla 的執行檔||
+
+註： /home/crawler/crawlzilla/user/_username_/webs/_DBName_ ==鍊結到==> /opt/crawlzilla/tomcat/webapps/_username_/_DBName_
+
+如：ln -sf /home/crawler/crawlzilla/user/admin/webs/test_3 /opt/crawlzilla/tomcat/webapps/admin/test_3
 
  * /var/log/crawlzilla/
 
  || 目錄1 || 目錄2 || 說明 ||
- || ./hadoop-logs ||  ||  ||
- || ./hadoop-pids ||  ||  ||
- || ./shell-logs ||  ||  ||
- || ./tomcat-logs ||  ||  ||
+ || ./hadoop-logs/ ||  ||  ||
+ || ./hadoop-pids/ ||  ||  ||
+ || ./shell-logs/ ||  ||  ||
+ || ./tomcat-logs/ ||  ||  ||
 
 == 新舊 檔案＼目錄 對照 ==
 
  || 舊 || ==> || 新 || 說明 ||
- || /home/crawler/crawlzilla/logs   ||   ==>  || 刪除此鍊結 ||  || 
- || /home/crawler/crawlzilla/nutch    || ==>  || 刪除此鍊結 ||  || 
- || /home/crawler/crawlzilla/source   || ==>  || /home/crawler/crawlzilla/slave ||  || 
+ || /home/crawler/crawlzilla/logs   ||   ==>  ||  || 刪除此鍊結 || 
+ || /home/crawler/crawlzilla/nutch    || ==>  ||  || 刪除此鍊結 || 
+ || /home/crawler/crawlzilla/tmp   || ==>  || /home/crawler/crawlzilla/tmp || 不變 || 
+ || /home/crawler/crawlzilla/source   || ==>  || /opt/crawlzilla/slave ||  || 
  || /home/crawler/crawlzilla/archieve/_DBName_  || ==>  ||  /home/crawler/crawlzilla/user/admin/IDB/_DBName_ ||  || 
- || /home/crawler/crawlzilla/tmp   || ==>  || /home/crawler/crawlzilla/tmp ||  || 
+
  || /home/crawler/crawlzilla/urls        || ==>  || /home/crawler/crawlzilla/meta/urls ||  || 
- || /home/crawler/crawlzilla/.metadata/_DBName_  || ==>  || /home/crawler/crawlzilla/user/admin/IDB/_DBName_/meta ||  || 
+ || /home/crawler/crawlzilla/.metadata/_DBName_  || ==>  || /home/crawler/crawlzilla/user/admin/IDB/_DBName_/meta (註2) ||  || 
  || /home/crawler/crawlzilla/.menu_tmp  || ==>  || /home/crawler/crawlzilla/meta/menu_tmp ||  || 
  || /home/crawler/crawlzilla/system/ || ==>  || 於下說明 ||  || 
+
+ * 註2: 0.3 版以前，無論完成與否的IDB中間資料都放在 /home/crawler/crawlzilla/.metadata/。但 1.0 版以後，未完成的 /home/crawler/crawlzilla/user/admin/tmp/_DBName_/meta ，完成之後搬移到 /home/crawler/crawlzilla/user/admin/IDB/_DBName_/meta
 
  * /home/crawler/crawlzilla/system: