Title :
Fast Data Reduction via KDE Approximation
Author :
Freedman, Daniel ; Kisilev, Pavel
Author_Institution :
Hewlett-Packard Labs., Haifa
Abstract :
Many of today´s real world applications need to handle and analyze continually growing amounts of data, while the cost of collecting data decreases. As a result, the main technological hurdle is that the data is acquired faster than it can be processed. Data reduction methods are thus increasingly important, as they allow one to extract the most relevant and important information from giant data sets. We present one such method, based on compressing the description length of an estimate of the probability distribution of a set points.
Keywords :
approximation theory; data compression; data reduction; pattern clustering; data clustering; data compression; data reduction; kernel density estimate approximation; mean shift algorithm; Bandwidth; Costs; Data compression; Data mining; Data structures; Hydrogen; Kernel; Laboratories; Probability distribution; Sampling methods; kernel density estimate; mean shift;
Conference_Titel :
Data Compression Conference, 2009. DCC '09.
Conference_Location :
Snowbird, UT
Print_ISBN :
978-1-4244-3753-5
DOI :
10.1109/DCC.2009.47