Title :
Generalization Error of Linear Discriminant Analysis in Spatially-Correlated Sensor Networks
Author :
Varshney, Kush R.
Author_Institution :
Bus. Analytics & Math. Sci. Dept., IBM Thomas J. Watson Res. Center, Yorktown Heights, NY, USA
fDate :
6/1/2012 12:00:00 AM
Abstract :
Generalization error, the probability of error of a detection rule learned from training samples on new unseen samples, is a fundamental quantity to be characterized. However, characterizations of generalization error in the statistical learning theory literature are often loose and practically unusable for optimizing detection systems. In this work, focusing on learning linear discriminant analysis detection rules from spatially-correlated sensor measurements, a tight generalization error approximation is developed that can be used to optimize the parameters of a sensor network detection system. As such, the approximation is used to optimize network settings. The approximation is also used to derive a detection error exponent and select an optimal subset of deployed sensor nodes. A Gauss-Markov random field is used to model correlation and weak laws of large numbers in geometric probability are employed in the analysis.
Keywords :
Gaussian processes; Markov processes; approximation theory; error statistics; wireless sensor networks; Gauss-Markov random field; deployed sensor nodes; detection error exponent; error probability; generalization error approximation; geometric probability; learning linear discriminant analysis detection rules; linear discriminant analysis; spatially-correlated sensor measurements; spatially-correlated sensor networks; statistical learning theory literature; Approximation methods; Correlation; Covariance matrix; Estimation; Linear discriminant analysis; Optimization; Training; Distributed sensors; generalization error; geometric probability; linear discriminant analysis; signal detection;
Journal_Title :
Signal Processing, IEEE Transactions on
DOI :
10.1109/TSP.2012.2190063