User identification design by fusion of face recognition and speaker recognition

Intelligent human-robot interface helps a mobile robot to extract external information and interact with a user. User identification information allows a robot to generate appropriate behaviors and make personalized human-robot interaction (PHRI) more natural and safe. Most of service robots move around in various application settings, and biometric features always change during relative movements. In this work, a fusion recognition system based on face and speaker classifiers is designed to achieve the user recognition in various environments. We propose a method to fuse face and speech recognition results based on the concept of confidence indices. Through the derived confidence indices, the system combines the two classifiers and gives improved recognition results. Experiments on a laboratory home service robot show that person recognition rates in 15 environmental situations all outperform those of using single modality.