Title :
Real Time Multimodal Interaction with Animated Virtual Human
Author :
Jin, Li ; Wen, Zhigang
Author_Institution :
Harrow Sch. of Comput. Sci., Westminster Univ., Harrow
Abstract :
This paper describes the design and implementation of a real time animation framework in which animated virtual human is capable of performing multimodal interactions with human user. The animation system consists of several functional components, namely perception, behaviours generation, and motion generation. The virtual human agent in the system has a complex underlying geometry structure with multiple degrees of freedom (DOFs). It relies on a virtual perception system to capture information from its environment and respond to human user´s commands by a combination of non-verbal behaviours including co-verbal gestures, posture, body motions and simple utterances. A language processing module is incorporated to interpret user´s command. In particular, an efficient motion generation method has been developed to combines both motion captured data and parameterized actions generated in real time to produce variations in agent´s behaviours depending on its momentary emotional states
Keywords :
computer animation; human computer interaction; real-time systems; virtual reality; animated virtual human agent; body motion generation; coverbal gesture; geometry structure; human user command; language processing module; momentary emotional state; motion captured data; multiple degrees of freedom; nonverbal behaviour generation; parameterized action; real time animation system; real time multimodal interaction; virtual perception system; Animation; Artificial intelligence; Computational modeling; Computer science; Geometry; Humans; Hybrid power systems; Real time systems; Shape; Speech processing;
Conference_Titel :
Information Visualization, 2006. IV 2006. Tenth International Conference on
Conference_Location :
London, England
Print_ISBN :
0-7695-2602-0