A gaze and speech multimodal interface

Author

Zhang, Qiaohui ; Imamiya, Atsumi ; Mao, Xiaoyang ; Go, Kentaro

Author_Institution

Dept. of Comput. & Media Eng., Yamanashi Univ., Kofu, Japan

fYear

2004

fDate

23-24 March 2004

Firstpage

208

Lastpage

213

Abstract

Eyesight and speech are two channels that humans naturally use to communicate with each other. However both the eye tracking and the speech recognition technique available today are still far from perfect. Our goal is find how to effectively make use of these error-prone information from both modes, in order to use one mode to correct errors of another mode, overcome the immature of recognition techniques, resolve the ambiguity of the user´s speaking, and improve the interaction speed. The integration strategies and the evaluation experiment demonstrate that these two modalities can be used multimodally to improve the usability and efficiency of user interface, which would not be available to speech-only or gaze-only systems.

Keywords

human computer interaction; interactive systems; multimedia systems; speech recognition; user interfaces; error-prone information; eye tracking; gaze multimodal interface; speech multimodal interface; speech recognition; user interface; user speaking; Computer interfaces; Error correction; Eyes; Humans; Information processing; Robustness; Speech processing; Speech recognition; Usability; User interfaces;

fLanguage

English

Publisher

ieee

Conference_Titel

Distributed Computing Systems Workshops, 2004. Proceedings. 24th International Conference on

Print_ISBN

0-7695-2087-1

Type

conf

DOI

10.1109/ICDCSW.2004.1284033

Filename

1284033