SEAR: towards a mobile and context-sensitive speech-enabled augmented reality

Author

Goose, S. ; Sudarsky, Sandra ; Zhang, X. ; Navab, N.

Author_Institution

Siemens Corporate Res., Princeton, NJ, USA

Volume

1

fYear

2002

fDate

6/24/1905 12:00:00 AM

Firstpage

849

Abstract

A maintenance engineer who talks to pumps and pipes may not seem like the ideal person to entrust with keeping a factory running smoothly, but we hope that our mobile speech-enabled augmented reality (SEAR) framework will enable such behavior in the future to be anything but suspicious. We describe how the SEAR framework uses our flexible and scalable vision-based localization techniques to offer the engineer a seamless multi-modal user interface. This interface juxtaposes a graphical augmented reality view with a context-sensitive speech dialog concerning the industrial equipment located in the immediate vicinity.

Keywords

augmented reality; maintenance engineering; speech processing; speech recognition; speech synthesis; user interfaces; 3D interaction techniques; graphical augmented reality view; industrial automation; industrial equipment; maintenance; multi-modal user interface; speech recognition; speech synthesis; speech-enabled augmented reality; vision-based localization techniques; Augmented reality; Containers; Educational institutions; Manufacturing automation; Navigation; Production facilities; Speech recognition; Speech synthesis; User interfaces; Virtual environment;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia and Expo, 2002. ICME '02. Proceedings. 2002 IEEE International Conference on

Print_ISBN

0-7803-7304-9

Type

conf

DOI

10.1109/ICME.2002.1035915

Filename

1035915