Title :
Multimodal interaction for 2D and 3D environments [virtual reality]
Author :
Cohen, Philip ; McGee, David ; Oviatt, Sharon ; Wu, Lizhong ; Clow, Joshua ; King, Robert ; Julier, Simon ; Rosenblum, Lawrence
Author_Institution :
Graduate Inst. of Sci. & Technol., Beaverton, OR, USA
Abstract :
The allure of immersive technologies is undeniable. Unfortunately, the user´s ability to interact with these environments lags behind the impressive visuals. In particular, it´s difficult to navigate in unknown visual landscapes, find entities, access information and select entities using six-degrees-of-freedom (6-DOF) devices. We believe multimodal interaction-specifically speech and gesture-will make a major difference in the usability of such environments
Keywords :
gesture recognition; human factors; speech recognition; speech-based user interfaces; technological forecasting; virtual reality; 2D environments; 3D environments; 6-degrees-of-freedom devices; entity finding; entity selection; gestural interaction; immersive technologies; information access; interactability; multimodal interaction; speech interaction; unknown visual landscape navigation; usability; virtual reality; Aerospace simulation; Computer displays; Layout; Navigation; Robustness; Speech analysis; Speech recognition; Virtual environment; Virtual reality; Visualization;
Journal_Title :
Computer Graphics and Applications, IEEE
