Title :
Design of an entertainment robot with multimodal human-robot interactions
Author :
Jean, Jong-Hann ; Chen, Kuan-Ting ; Shih, Kuang-Yao ; Lin, Hsiu-li
Author_Institution :
Dept. of Electr. Eng., St. John´´s Univ., Tamsui
Abstract :
The paper presents the design of an entertainment robot focusing on development of multiple modalities of human-robot interactions. The robot system integrates a 16-bit cost-effective embedded MCU, SPCE061A, and a variety of sensory input/output systems to fulfill multimodal interactions. First, it utilizes the ADC and DACs hardware units and the speech processing software library of SPCE061A to realize an interactive dialogue system with speech recognition capability. Next, it combines an assembled head with several facial feature components and control the movements of the head and the facial features to express several head gestures and facial expressions. Furthermore, it arranges an array of microphone modules surrounding the robot body to detect the direction of sound sources according to sequence of arrival times. Finally, it incorporates the afore-mentioned modalities of interactions to provide several behaviors of the entertainment robot, such as singing, crying, laughing and looking around, correspondent to different events.
Keywords :
human-robot interaction; service robots; entertainment robot; facial expressions; facial feature components; head gestures; interactive dialogue system; microphone modules; multimodal human-robot interactions; robot system; speech processing software library; speech recognition; Cognitive robotics; Facial features; Hardware; Human robot interaction; Intelligent robots; Microphone arrays; Psychology; Robot sensing systems; Service robots; Speech recognition; entertainment robots; human-robot interactions; multiple modalities;
Conference_Titel :
SICE Annual Conference, 2008
Conference_Location :
Tokyo
Print_ISBN :
978-4-907764-30-2
Electronic_ISBN :
978-4-907764-29-6
DOI :
10.1109/SICE.2008.4654884