DocumentCode :
1685011
Title :
Robust versions of the Tukey boxplot with their application to detection of outliers
Author :
Shevlyakov, Georgy ; Andrea, Kliton ; Choudur, Lakshminarayan ; Smirnov, Pavel ; Ulanov, Alexander ; Vassilieva, Natalia
Author_Institution :
Dept. of Appl. Math., St. Petersburg State Polytech. Univ., St. Petersburg, Russia
fYear :
2013
Firstpage :
6506
Lastpage :
6510
Abstract :
The need for fast on-line algorithms to analyze high data-rate measurements is a vital element in production settings. Given the ever-increasing number of data sources coupled with increasing complexity of applications, and workload patterns, anomaly detection methods should be light-weight and must operate in real-time. In many modern applications, data arrive in a streaming fashion. Therefore, the underlying assumption of classical methods that the data is a sample from a stable distribution is not valid, and Gaussian and non-parametric based methods such as the control chart and boxplot are inadequate. Streaming data is an ever-changing superposition of distributions. Detection of such changes in real-time is one of the fundamental challenges. We propose low-complexity robust modifications to the conventional Tukey boxplot based on fast highly efficient robust estimates of scale. Results using synthetic as well as real-world data show that our methods outperform the Tukey boxplot and methods based on Gaussian limits.
Keywords :
data visualisation; statistical analysis; Tukey boxplot; anomaly detection method; low complexity robust modification; outlier detection; robust estimation; streaming data; Contamination; Data analysis; Electric breakdown; Pollution measurement; Probability; Robustness; Standards; boxplot; outlier; robustness;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on
Conference_Location :
Vancouver, BC
ISSN :
1520-6149
Type :
conf
DOI :
10.1109/ICASSP.2013.6638919
Filename :
6638919
Link To Document :
بازگشت