DocumentCode :
2759196
Title :
VR Interaction in Real-Time between Avatar with Voice and Gesture Recognition System
Author :
Uchino, Shunji ; Tanaka, Kazuaki ; Taki, Hirokazu ; Abe, Norihiro ; Yagi, Tetsuya ; He, Shoujie
Author_Institution :
Kyushu Inst. of Technol., Kyushu
Volume :
2
fYear :
2007
fDate :
21-23 May 2007
Firstpage :
959
Lastpage :
964
Abstract :
In this research, a dialog environment between human and virtual agent has been constructed. With the commercial off-the-shelf VR technologies, special devices such as data glove have to be used for the interaction. But this is difficult to manipulate objects. If there is a helper who has direct access to objects in a virtual space, we may ask him. The question, however, is how to communicate with the helper. This paper presents a solution to the question. The basic idea is to utilize speech recognition and gesture recognition systems. Experimental results have proved the effectiveness of the approach in terms of facilitating man-machine interaction and communication. The environment constructed in this research allows a user to communicate by talking and showing gestures to a personified agent in virtual environment. A user can use his/her finger to point at a virtual object and ask the agent to manipulate the virtual object.
Keywords :
avatars; gesture recognition; speech recognition; avatar; dialog environment; gesture recognition system; human agent; man-machine interaction; real-time virtual reality interaction; virtual agent; voice recognition system; Avatars; Data gloves; Fingers; Humans; Man machine systems; Real time systems; Space technology; Speech recognition; Virtual environment; Virtual reality;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Advanced Information Networking and Applications Workshops, 2007, AINAW '07. 21st International Conference on
Conference_Location :
Niagara Falls, Ont.
Print_ISBN :
978-0-7695-2847-2
Type :
conf
DOI :
10.1109/AINAW.2007.370
Filename :
4224230
Link To Document :
بازگشت