Title :
Fundamental finite-sample limit of canonical correlation analysis based detection of correlated high-dimensional signals in white noise
Author :
Nadakuditi, Raj Rao
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Univ. of Michigan, Ann Arbor, MI, USA
Abstract :
Canonical correlation analysis (CCA) based techniques are often used for detecting and estimating correlated signals buried in two multivariate datasets. In this paper, we highlight a fundamental asymptotic limit of CCA based detection and estimation of the number of weak, correlated high-dimensional signals in the white noise, sample size limited setting. Specifically, we show that if (eigen) SNR of the correlated signal(s) in both datasets is above the respective threshold SNRs then reliable detection of the correlated signal(s), relative to the noise-only or correlated-signal-free scenario, is possible. The fundamental limit depends on the dimensionality of the dataset and sample-size but, perhaps surprisingly, not on the degree of correlation between the signals. We develop a new test statistic that leads to an improved algorithm that attains this limit and that can be reliably used in the sample size deficient regime where previous authors have asserted otherwise.
Keywords :
correlation methods; eigenvalues and eigenfunctions; estimation theory; signal detection; statistical testing; white noise; CCA based detection; CCA based estimation; CCA based techniques; canonical correlation analysis based detection; correlated high-dimensional signals; correlated signal detection; correlated-signal-free scenario; eigen SNR; fundamental asymptotic limit; fundamental finite-sample limit; multivariate datasets; noise-only scenario; reliable detection; respective threshold SNR; sample size limited setting; test statistic; white noise; Correlation; Covariance matrix; Eigenvalues and eigenfunctions; Equations; Reliability theory; Signal to noise ratio; White noise;
Conference_Titel :
Statistical Signal Processing Workshop (SSP), 2011 IEEE
Conference_Location :
Nice
Print_ISBN :
978-1-4577-0569-4
DOI :
10.1109/SSP.2011.5967714