Title :
Multimodal human-robot interaction
Author :
Budkov, V. Yu ; Prischepa, M.V. ; Ronzhin, A.L. ; Karpov, A.A.
Author_Institution :
Speech & Multimodal Interfaces Lab., Russian Acad. of Sci., St. Petersburg, Russia
Abstract :
Multimodal human-computer interface provides a connection between a user and a computer in a natural manner. In order to determine position of the user and his speech queries, the robot uses a set of web-cameras, microphone array and technologies for distant speech recognition and face tracking. There are some methods for interaction between users and computers, such as manual entry, verbal dialog, visual and emotional communications. Interaction model of the proposed mobile informational robot has 3 main parts: beginning of the dialogue, task execution and completion of the dialogue. Further development of the model is aimed to implement a technology for gesture recognition for supporting a special group of disabled people.
Keywords :
gesture recognition; human-robot interaction; mobile robots; speech recognition; distant speech recognition; emotional communications; face tracking; gesture recognition; manual entry; microphone array; multimodal human-robot interaction; task completion; task execution; verbal dialog; visual communications; web-cameras; Computers; Humans; Mobile communication; Robot sensing systems; Speech; Speech recognition; human-computer interaction; mobile informational robot; multimodal interface; speech recognition;
Conference_Titel :
Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), 2010 International Congress on
Conference_Location :
Moscow
Print_ISBN :
978-1-4244-7285-7
DOI :
10.1109/ICUMT.2010.5676593
