Title :
A multi-protocol network log clustering method based on grid
Author_Institution :
Comput. Dept., Shandong Police Coll., Jinan, China
Abstract :
To deal with large scale network log and provide brief data sources for the later log analysis, the thesis propose a multi-protocol network log clustering method based on grid, which plot every log into data grid and first clustering in the grid,then According to similarity judgment, make the initial cluster secondary clustering, finally output clustered log, some sparse data and outlier data. Experiment result shows that the method can effectively compress log storage, reduce the time complexity, deal with actual dynamic data and realize incremental clustering.
Keywords :
Internet; grid computing; information storage; pattern clustering; protocols; data grid; data sources; incremental clustering; initial cluster secondary clustering; large scale network log; log storage; multiprotocol network log clustering method; outlier data; similarity judgment; sparse data; time complexity; Clustering algorithms; Clustering methods; Databases; Hafnium; Heuristic algorithms; Lenses; Protocols; grid-based clustering; incremental clustering; log analysis; network log; similarity;
Conference_Titel :
IT in Medicine and Education (ITME), 2011 International Symposium on
Conference_Location :
Cuangzhou
Print_ISBN :
978-1-61284-701-6
DOI :
10.1109/ITiME.2011.6132164