Title :
A theoretical performance analysis of the Bayesian data reduction algorithm
Author :
Lynch, Robert S., Jr. ; Willett, Peter K.
Author_Institution :
Signal Process. Branch, Naval Undersea Warfare Center, Newport, RI, USA
Abstract :
The purpose of this paper is to analytically demonstrate the effect that the overall quantization, M, has on the relative performance of the BDRA (Bayesian Data Reduction Algorithm). In particular, it is of interest to show with a straightforward data model how the dimensionality reduction aspects of the BDRA improves overall classification performance on the training data. In other words, it is analytically shown the conditions under which the probability of error, as computed on the data, is lower after dimensionality reduction. Results are illustrated by plotting the analytical probability of error as a function of the number of data merged in the same discrete cell. An interesting result demonstrates that data merged under different classes in the same discrete cell can improve classification performance.
Keywords :
Bayes methods; data reduction; Bayesian data reduction; data model; dimensionality reduction; discrete classification; overall quantization; supervised learning; theoretical performance analysis; Algorithm design and analysis; Bayesian methods; Computational modeling; Data models; Electrical capacitance tomography; Performance analysis; Quantization; Signal analysis; Signal processing algorithms; Training data; Discrete classification; dimensionality reduction; supervised learning; theoretical modeling;
Conference_Titel :
Systems, Man and Cybernetics, 2005 IEEE International Conference on
Print_ISBN :
0-7803-9298-1
DOI :
10.1109/ICSMC.2005.1571167