| Version 8 (modified by waue, 15 years ago) (diff) |
|---|
- FuseAlert.java 100% finished and testing finished
實驗一： 一個檔案, 共7行
1;538;15;NETBIOS SMB IPC$ unicode share access ;Generic Protocol Command ecode;3;09;04;17;53;56;168.150.177.165:1051;168.150.177.166:139;TCP; 1;538;15;NETBIOS SMB IPC$ unicode share access ;Generic Protocol Command Decode;3;10;04;20;53;56;168.150.177.165:1051;168.150.177.166:139;TCP; 1;1917;6;SCAN UPnP service discover attempt ;Detection of a Network Scan;3;09;04;17;43;56;168.150.177.164:1032;239.255.255.250:1900;UDP; 1;1927;6;SCAN UPnP service discover attempt ;Detection of a Network Scan;3;09;04;17;43;56;168.150.177.164:1032;239.255.255.250:1900;UDP; 1;1927;6;SCAN UPnP service discover attempt ;Detection of a Network Scan;3;09;04;17;43;56;140.110.100.100:1032;239.255.255.250:1900;UDP; 1;1917;6;SCAN UPnP service discover attempt ;Detection of a Network Scan;3;09;04;17;53;56;168.150.177.164:1032;239.255.255.250:1900;UDP; 1;1917;6;SCAN UPnP service discover attempt ;Detection of a Network Scan;3;09;14;20;00;00;168.150.177.164:1032;239.255.255.250:1900;UDP;
to
1917;SCAN UPnP service discover attempt ;Detection of a Network Scan;3@@168.150.177.164@@239.255.255.250 904174356-914200000 1927;SCAN UPnP service discover attempt ;Detection of a Network Scan;3@@140.110.100.100@@239.255.255.250 904174356-904174356 1927;SCAN UPnP service discover attempt ;Detection of a Network Scan;3@@168.150.177.164@@239.255.255.250 904174356-904174356 538;NETBIOS SMB IPC$ unicode share access ;Generic Protocol Command Decode;3@@168.150.177.165@@168.150.177.166 904175356-1004205356
- 單一FuseAlert 需 23秒左右
實驗二、六個檔案，共620186行
- 從正歸化到FuseAlert，化簡成 15150 行， 共需46.407秒
注意要點：
- the output is difference between Map and Reduce class !
// set Map output key and value class job.setMapOutputKeyClass(Text.class); job.setMapOutputValueClass(LongWritable.class); // set Reduce output key and value class job.setOutputKeyClass(Text.class); job.setOutputValueClass(Text.class);
- 由於時間的位元長度過長，故20090101595959 已經超過 intWritable 的定址範圍
改為 0101595959 用 longWritable 宣告
- 在map 與 reduce class內宣告重要參數，需用全名，如 int 改為 Integer 較佳
- 也許因為key 過長，因此似乎影響到效能，此job 需run完需20secs
