A model-based gaze tracking system

Author

Stiefelhagen, Rainer ; Yang, Jie ; Waibel, Alex

Author_Institution

Interactive Syst. Lab., Carnegie Mellon Univ., Pittsburgh, PA, USA

fYear

1996

fDate

4-5 Nov 1996

Firstpage

304

Lastpage

310

Abstract

In this paper we present a non-intrusive model-based gaze tracking system. The system estimates the 3D pose of a user´s head by tracking as few as six facial feature points. The system locates a human face using a statistical color model without any mark on the face and then traces the facial features, such as eyes, nostrils and lip corners. A full perspective model is employed to map these feature points onto the 3D pose. Several techniques have been developed to track the features points and recover from failure. We currently achieve a frame rate of 15+ frames per second using an HP 9000 workstation with a frame grabber and a Canon VC-C1 camera. The application of the system has been demonstrated by a gaze-driven panorama image viewer. The potential applications of the system include multimodal interfaces, virtual reality and video-teleconferencing

Keywords

computer vision; face recognition; feature extraction; image colour analysis; iterative methods; object recognition; optical tracking; statistical analysis; stereo image processing; 3D pose estimation; HP 9000 workstation; computer vision; facial feature extraction; frame grabber; gaze-driven panorama image viewer; model-based gaze tracking system; statistical color model; video camera; Application software; Cameras; Eyes; Face; Facial features; Head; Humans; Interactive systems; Laboratories; Radar tracking;

fLanguage

English

Publisher

ieee

Conference_Titel

Intelligence and Systems, 1996., IEEE International Joint Symposia on

Conference_Location

Rockville, MD

Print_ISBN

0-8186-7728-7

Type

conf

DOI

10.1109/IJSIS.1996.565083

Filename

565083