Title :
Multimodal interaction with a wearable augmented reality system
Author :
Kölsch, Mathias ; Bane, Ryan ; Höllerer, Tobias ; Turk, Matthew
Author_Institution :
Dept. of Comput. Sci., Naval Postgraduate Sch., Monterey, CA
Abstract :
An augmented reality system enhances a mobile user´s situational awareness and provides new visualization functionality. The custom-built multimodal interface provides access to information encountered in urban environments. In this article, we detail our experiences with various input devices and modalities and discuss their advantages and drawbacks in the context of interaction tasks in mobile computing. We show how we integrated the input channels to use the modalities beneficially and how this enhances the interface´s overall usability
Keywords :
augmented reality; data visualisation; mobile computing; user interfaces; custom-built multimodal interface; mobile computing; multimodal interaction; situational awareness; urban environment; visualization functionality; wearable augmented reality system; Augmented reality; Buildings; Cities and towns; Clouds; Computer displays; Filters; Fingers; Information filtering; Temperature; Visualization; augmented reality; hand-gesture recognition; information visualization; multimodal interface; wearable computing;
Journal_Title :
Computer Graphics and Applications, IEEE
DOI :
10.1109/MCG.2006.66