An evaluation of intrinsic dimensionality estimators

Author

Verveer, Peter J. ; Duin, Robert P W

Author_Institution

Fac. of Appl. Phys., Delft Univ. of Technol., Netherlands

Volume

17

Issue

1

fYear

1995

fDate

1/1/1995 12:00:00 AM

Firstpage

81

Lastpage

86

Abstract

The intrinsic dimensionality of a data set may be useful for understanding the properties of classifiers applied to it and thereby for the selection of an optimal classifier. In this paper the authors compare the algorithms for two estimators of the intrinsic dimensionality of a given data set and extend their capabilities. One algorithm is based on the local eigenvalues of the covariance matrix in several small regions in the feature space. The other estimates the intrinsic dimensionality from the distribution of the distances from an arbitrary data vector to a selection of its neighbors. The characteristics of the two estimators are investigated and the results are compared. It is found that both can be applied successfully, but that they might fail in certain cases. The estimators are compared and illustrated using data generated from chromosome banding profiles

Keywords

covariance matrices; eigenvalues and eigenfunctions; image classification; chromosome banding profiles; classifiers; covariance matrix; data set; intrinsic dimensionality estimators; local eigenvalues; optimal classifier; Biological cells; Chemical technology; Chemistry; Covariance matrix; Data analysis; Eigenvalues and eigenfunctions; Neural networks; Pattern recognition; Physics; Vectors;

fLanguage

English

Journal_Title

Pattern Analysis and Machine Intelligence, IEEE Transactions on

Publisher

ieee

ISSN

0162-8828

Type

jour

DOI

10.1109/34.368147

Filename

368147