Title :
Parametric dimensionality reduction by unsupervised regression
Author :
Carreira-Perpinán, Miguel Á ; Lu, Zhengdong
Author_Institution :
EECS, Univ. of California, Merced, CA, USA
Abstract :
We introduce a parametric version (pDRUR) of the recently proposed Dimensionality Reduction by Unsupervised Regression algorithm. pDRUR alternately minimizes reconstruction error by fitting parametric functions given latent coordinates and data, and by updating latent coordinates given functions (with a Gauss-Newton method decoupled over coordinates). Both the fit and the update become much faster while attaining results of similar quality, and afford dealing with far larger datasets (105 points). We show in a number of benchmarks how the algorithm efficiently learns good latent coordinates and bidirectional mappings between the data and latent space, even with very noisy or low-quality initializations, often drastically improving the result of spectral and other methods.
Keywords :
Newton method; image reconstruction; regression analysis; Gauss-Newton method; bidirectional mapping; latent coordinates; pDRUR parametric version; parametric dimensionality reduction; parametric function fitting; reconstruction error; unsupervised regression; Computational efficiency; Costs; Laplace equations; Least squares methods; Minimization methods; Nearest neighbor searches; Newton method; Recursive estimation; Robustness; Testing;
Conference_Titel :
Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on
Conference_Location :
San Francisco, CA
Print_ISBN :
978-1-4244-6984-0
DOI :
10.1109/CVPR.2010.5539862