Title :
The Human–Biometric-Sensor Interaction Evaluation Method: Biometric Performance and Usability Measurements
Author :
Kukula, Eric P. ; Sutton, Mathias J. ; Elliott, Stephen J.
Author_Institution :
Dept. of Ind. Technol., Purdue Univ., West Lafayette, IN, USA
fDate :
4/1/2010 12:00:00 AM
Abstract :
This paper discusses the human-biometric-sensor interaction (HBSI) evaluation method that uses ergonomics, usability, and sample quality criteria as explanatory variables for the overall biometric system performance. The HBSI method was proposed because of questions regarding the thoroughness of traditional system-level performance evaluation metrics such as the failure-to-acquire (FTA) rate, the failure-to-enroll (FTE) rate, the false-accept rate (FAR), and the false-reject rate (FRR). Data were collected from 85 individuals over three visits that accounted for 25 867 user interactions with three swipe-based fingerprint sensors. The results in this paper revealed that traditional biometric evaluations that focus on system-level metrics are not providing sufficient reporting details regarding the user interaction with the devices. In this paper, the systemic FTA rate of 14.38% was shown to be segmented into three metrics: false interaction (FI), failure to detect (FTD), and concealed interaction (CI). The results show that the FI accounted for 69.05% of the systemic FTA presentations, FTD accounted for 30.71%, and CI accounted for 0.24%. Overall, the HBSI evaluation method and framework for biometric interactions provided new metrics that improve the analysis capabilities for biometric performance evaluations as it links system feedback to the human-sensor interaction, enabling researchers, system designers, and implementers to understand if the issues are the result of the system, the user, both the system and the user, or some other extraneous factor.
Keywords :
biometrics (access control); ergonomics; fingerprint identification; image processing equipment; performance evaluation; user interfaces; biometric performance; biometric system performance; concealed interaction; ergonomics; failure to acquire rate; failure to detect; failure to enroll rate; false accept rate; false interaction; false reject rate; human biometric sensor interaction evaluation method; sample quality criteria; swipe based fingerprint sensor; system level performance evaluation metrics; usability measurement; user interactions; Biometrics; error rates; human–biometric-sensor interaction (HBSI); measurement; testing and reporting; usability;
Journal_Title :
Instrumentation and Measurement, IEEE Transactions on
DOI :
10.1109/TIM.2009.2037878