DocumentCode :
2667651
Title :
Lip movement and gesture recognition for a multimodal human-computer interface
Author :
Dalka, Piotr ; Czyzewski, Andrzej
Author_Institution :
Multimedia Syst. Dept., Gdansk Univ. of Technol., Gdansk, Poland
fYear :
2009
fDate :
12-14 Oct. 2009
Firstpage :
451
Lastpage :
455
Abstract :
This paper presents an algorithm for lip movement tracking and lip gesture recognition for the purpose of the multimodal human-computer interface (HCI) called LipMouse. This solution allows a user to work on a computer using movement and gesture made by his/her mouths only and is especially useful for severely disabled and paralyzed people. User face images are captured with a standard webcam. Face detection is based on a cascade of boosted classifiers using Haar-like features. A mouth region is located in the lower part of the face region and is used to track lip movements. Three lip gestures are recognized: mouth opening, sticking out the tongue and making the mouth into an ¿0¿ shape. Lip gesture recognition is performed by an artificial neural network and utilizes an accurate lip shape obtained by the means of lip image segmentation using fuzzy clustering.
Keywords :
face recognition; gesture recognition; handicapped aids; image segmentation; pattern classification; pattern clustering; user interfaces; Haar-like features; LipMouse; boosted classifiers; disabled people; face detection; fuzzy clustering; lip gesture recognition; lip image segmentation; lip movement tracking; mouth region; multimodal human-computer interface; paralyzed people; user face images; Artificial neural networks; Face detection; Fuzzy neural networks; Human computer interaction; Image recognition; Image segmentation; Mouth; Shape; Tongue; Tracking;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Computer Science and Information Technology, 2009. IMCSIT '09. International Multiconference on
Conference_Location :
Mragowo
Print_ISBN :
978-1-4244-5314-6
Type :
conf
DOI :
10.1109/IMCSIT.2009.5352685
Filename :
5352685
Link To Document :
بازگشت