A new method for noise data detection based on DBSCAN and SVDD

Author

Shengxuan Hao;Xiaofeng Zhou;Hong Song

Author_Institution

Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, China, University of Chinese Academy of Sciences, Beijing, China, Key Laboratory of Network Control System, Chinese, Academy of Sciences, Shenyang, China

fYear

2015

fDate

6/1/2015 12:00:00 AM

Firstpage

784

Lastpage

789

Abstract

To improve the quality of real datasets by remove noise data, a new method for noise data detection based on Density-Based Spatial Clustering of Applications with Noise (DBSCAN) and support vector data description (SVDD) was proposed in this article. Firstly, classical DBSCAN algorithm was used to cluster the data and remove the outliers. Secondly, SVDD was used to train the grouped data according to the cluster result, and gained discriminant model for each group. All these discriminant models were used in whole dataset to classify the data. The point does not belong to any class is identified as noise data and be removed. Experimental studies are done using UCI dataset. It is shown that the method we proposed is considerably efficient.

Keywords

"Noise","Clustering algorithms","Classification algorithms","Time complexity","Algorithm design and analysis","Detection algorithms","Kernel"

Publisher

ieee

Conference_Titel

Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), 2015 IEEE International Conference on

Print_ISBN

978-1-4799-8728-3

Type

conf

DOI

10.1109/CYBER.2015.7288042

Filename

7288042