Title :
Multimodal integration
Author :
Blattner, Meera M. ; Glinert, Ephraim P.
Author_Institution :
Dept. of Appl. Sci., California Univ., Davis, CA, USA
Abstract :
Advances in multimedia, virtual reality, and immersive environments have expanded human computer interaction beyond text and vision to include touch, gestures, voice, and 3D sound. Although well developed single modalities for communication already exist, we do not really understand the general problem of designing integrated multimodal systems. We explore this issue and the diverse approaches to it, with emphasis on a generic platform to support multimodal interaction
Keywords :
human factors; interactive systems; multimedia computing; virtual reality; 3D sound; generic platform; human computer interaction; immersive environments; integrated multimodal systems; multimedia; multimodal integration; multimodal interaction; single modalities; virtual reality; Computer graphics; Electronic mail; Force feedback; Handicapped aids; Humans; Instruments; Physics computing; Shape; Speech; Writing;
Journal_Title :
MultiMedia, IEEE