Title :
Research and experiment of lip coordination with speech for the humanoid head robot-“H&Frobot-III”
Author :
Qingmei, Meng ; Weiguo, Wu ; Yusheng, Zhong ; Ce, Song
Author_Institution :
Dept. of Mechanism Design, Harbin Inst. of Technol., Harbin
Abstract :
This paper proposes a method of lip shape coordination with speech in the facial expression robot system ldquoH&Frobot-IIIrdquo. The proposed method can model the talking robotpsilas lip shape using visual speech system, which includes three modules: speech recognition, lip shape recognition and lip pose actuator. In the lip shape recognition module, a viseme representation method is proposed for synthesising the human visual speech. To analyze the robotpsilas lip shape, lip shape model is developed based on the anatomy and facial action coding system (FACS). When robot speaking, the lip shape coordination with speech can be realized through basic lip shape or the combination of basic lip shape. In the ldquoH&Frobot-IIIrdquo system, the lip shape is realized through slide and guide slot mechanism, which implements the two-way movement of muscle in the lip. Finally, the result of the experiment, which is the lip coordination with speech, is shown. When speaking same word, the lip shape of robot is similarity to that of human.
Keywords :
emotion recognition; face recognition; human-robot interaction; humanoid robots; robot vision; shape recognition; speech recognition; speech synthesis; H&Frobot-III; facial action coding system; facial expression robot system; guide slot mechanism; humanoid head robot; lip pose actuator; lip shape coordination; lip shape recognition; slide slot mechanism; speech recognition; viseme representation; visual speech synthesis; Actuators; Human robot interaction; Humanoid robots; Magnetic heads; Robot kinematics; Robot sensing systems; Shape; Speech recognition; Speech synthesis; Temperature sensors;
Conference_Titel :
Humanoid Robots, 2008. Humanoids 2008. 8th IEEE-RAS International Conference on
Conference_Location :
Daejeon
Print_ISBN :
978-1-4244-2821-2
Electronic_ISBN :
978-1-4244-2822-9
DOI :
10.1109/ICHR.2008.4756012