DocumentCode
384182
Title
Relationship between identification metrics: expected confusion and area under a ROC curve
Author
Johnson, Amos Y. ; Bobick, Aaron F.
Author_Institution
Dept. of Electr. & Comput. Eng., Georgia Tech., Atlanta, GA, USA
Volume
3
fYear
2002
fDate
2002
Firstpage
662
Abstract
The mathematical relationship between the expected-confusion metric and the area under a receiver operating characteristic (ROC) curve is derived. Given a limited database of subjects and an identification technique that generates a feature vector per subject, expected confusion is used to predict how well the feature vector will filter identity in a larger population. Related is the area under a ROC curve that can be used to determine the probability of correctly discriminating between subjects given the feature vector. These two measures have different connotations, but we show mathematically and verify experimentally that a simple transformation can be applied to the expected confusion to find the probability of incorrectly discriminating between subjects, which is the complement of the area under a ROC curve. Furthermore, we show that as a function of the number of subjects, this transformed expected-confusion measure converges more quickly than direct calculation of the area under a ROC curve.
Keywords
image recognition; probability; visual databases; ROC curve; database; expected-confusion metric; experiment; feature vector; identification metrics; image recognition; probability; receiver operating characteristic curve; Area measurement; Biometrics; Filters; Information theory; Legged locomotion; Mutual information; Particle measurements; Spatial databases; Strips; Testing;
fLanguage
English
Publisher
ieee
Conference_Titel
Pattern Recognition, 2002. Proceedings. 16th International Conference on
ISSN
1051-4651
Print_ISBN
0-7695-1695-X
Type
conf
DOI
10.1109/ICPR.2002.1048026
Filename
1048026
Link To Document