• DocumentCode
    384182
  • Title

    Relationship between identification metrics: expected confusion and area under a ROC curve

  • Author

    Johnson, Amos Y. ; Bobick, Aaron F.

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Georgia Tech., Atlanta, GA, USA
  • Volume
    3
  • fYear
    2002
  • fDate
    2002
  • Firstpage
    662
  • Abstract
    The mathematical relationship between the expected-confusion metric and the area under a receiver operating characteristic (ROC) curve is derived. Given a limited database of subjects and an identification technique that generates a feature vector per subject, expected confusion is used to predict how well the feature vector will filter identity in a larger population. Related is the area under a ROC curve that can be used to determine the probability of correctly discriminating between subjects given the feature vector. These two measures have different connotations, but we show mathematically and verify experimentally that a simple transformation can be applied to the expected confusion to find the probability of incorrectly discriminating between subjects, which is the complement of the area under a ROC curve. Furthermore, we show that as a function of the number of subjects, this transformed expected-confusion measure converges more quickly than direct calculation of the area under a ROC curve.
  • Keywords
    image recognition; probability; visual databases; ROC curve; database; expected-confusion metric; experiment; feature vector; identification metrics; image recognition; probability; receiver operating characteristic curve; Area measurement; Biometrics; Filters; Information theory; Legged locomotion; Mutual information; Particle measurements; Spatial databases; Strips; Testing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Pattern Recognition, 2002. Proceedings. 16th International Conference on
  • ISSN
    1051-4651
  • Print_ISBN
    0-7695-1695-X
  • Type

    conf

  • DOI
    10.1109/ICPR.2002.1048026
  • Filename
    1048026