A fast and robust 3D head pose and gaze estimation system

Author

Kinoshita, Koichi ; Lao, Shihong

Author_Institution

Core Technol. Center, OMRON Corp., Kizugawa

fYear

2008

fDate

17-19 Sept. 2008

Firstpage

1

Lastpage

2

Abstract

We developed a fast and robust head pose and gaze estimation system. This system can detect facial feature points and estimate 3D pose angles and gaze direction in various conditions including changes in facial expression, partial occlusion, etc. The system needs only one face image as input and doesn´t need any special devices such as blinking LED or stereo camera. Moreover, no calibration process is needed. It shows 95% of head pose estimation accuracy and 81% of gaze estimation accuracy (when the error margin is 15 degrees). The processing time is approximately 15ms/frame (Pentium4 3.2 GHz). Acceptable range of facial pose is within +/- 60 degrees in yaw (left-right) and within +/- 30 degrees in pitch (up-down).

Keywords

face recognition; pose estimation; stereo image processing; LED; face image; facial expression; facial feature point detection; gaze estimation system; partial occlusion; robust 3D head pose angle estimation; stereo camera; Calibration; Cameras; Face detection; Facial features; Head; Lighting; Real time systems; Robustness; Streaming media; Universal Serial Bus;

fLanguage

English

Publisher

ieee

Conference_Titel

Automatic Face & Gesture Recognition, 2008. FG '08. 8th IEEE International Conference on

Conference_Location

Amsterdam

Print_ISBN

978-1-4244-2153-4

Electronic_ISBN

978-1-4244-2154-1

Type

conf

DOI

10.1109/AFGR.2008.4813466

Filename

4813466