A friendly and intelligent human-robot interface system based on human face and hand gesture

Author

Chang, Ming-Shaung ; Chou, Jung-Hua

Author_Institution

Dept. of Eng. Sci., Nat. Cheng Kung Univ., Tainan, Taiwan

fYear

2009

fDate

14-17 July 2009

Firstpage

1856

Lastpage

1861

Abstract

A friendly and intelligent human-robot interface (HRI) system based on machine vision is established in this paper. A user uses his/her face and hand gestures to communicate with the robot. Three kinds of face detection, including shape, similarity and lip detections, are adopted to improve the recognition accuracy. The recognition of hand gestures is implemented through PCA, BPANN and their combined classifier. Successive dynamic commands are processed by dynamic programming. Experimental results show that the devised natural HRI works well and the system can process 8 image frames per second for practical real time applications.

Keywords

backpropagation; dynamic programming; face recognition; gesture recognition; human-robot interaction; image classification; neural nets; object detection; principal component analysis; robot vision; back propagation artificial neural network classifier; dynamic programming; friendly human-robot interface system; hand gesture recognition; human face detection; intelligent human-robot interface system; lip detection; machine vision; principal component analysis; shape detection; similarity detection; Dynamic programming; Face detection; Face recognition; Humans; Intelligent robots; Intelligent systems; Machine intelligence; Machine vision; Principal component analysis; Shape;

fLanguage

English

Publisher

ieee

Conference_Titel

Advanced Intelligent Mechatronics, 2009. AIM 2009. IEEE/ASME International Conference on

Conference_Location

Singapore

Print_ISBN

978-1-4244-2852-6

Type

conf

DOI

10.1109/AIM.2009.5229793

Filename

5229793