Computer vision for face-to-face human-computer interaction

Summary is only given: computer vision will play an important role in future human-computer interactions. In order to achieve natural human-computer interaction, there is a need for the computer to be able to interact with the user similar to the way human-human interaction takes place. In recent years we have been investigating various methods for different tasks of face-to-face interaction. Many of these are using image and video descriptors based on local binary patterns (LBP). This talk overviews our recent progress in LBP descriptors, face recognition and biometrics, recognition of facial expressions and emotions, visual speech recognition, synthesis of a talking face, and recognition of human actions and gestures. Results of our research on an experimental system for intelligent humanrobot interaction are also discussed.