Title :
SenseShapes: using statistical geometry for object selection in a multimodal augmented reality
Author :
Olwal, Alex ; Benko, Hrvoje ; Feiner, Steven
Author_Institution :
Dept. of Comput. Sci., Columbia Univ., New York, NY, USA
Abstract :
We introduce a set of statistical geometric tools designed to identify the objects being manipulated through speech and gesture in a multimodal augmented reality system. SenseShapes are volumetric regions of interest that can be attached to parts of the user´s body to provide valuable information about the user´s interaction with objects. To assist in object selection, we generate a rich set of statistical data and dynamically choose which data to consider based on the current situation.
Keywords :
audio user interfaces; augmented reality; computational geometry; haptic interfaces; speech recognition; speech-based user interfaces; SenseShapes; geometric tools; gesture identification; multimodal augmented reality; object selection; speech identification; statistical data; statistical geometry; user body; user interaction; volumetric regions; Augmented reality; Buildings; Computer science; Fusion power generation; Geometry; Head; Microphones; Monitoring; Optical sensors; Speech recognition;
Conference_Titel :
Mixed and Augmented Reality, 2003. Proceedings. The Second IEEE and ACM International Symposium on
Print_ISBN :
0-7695-2006-5
DOI :
10.1109/ISMAR.2003.1240730