Title :
Inner lip feature extraction for MPEG-4 facial animation
Author :
Wu, Zhilin ; Aleksic, Petar S.
Author_Institution :
Dept. of Electr. & Comput. Eng., Northwestern Univ., Evanston, IL, USA
Abstract :
It is very important to accurately track the mouth of a talking person for many applications, such as face recognition, audiovisual speech recognition and human computer interaction. This is in general a difficult problem due to the complexity of shapes, colors, textures, and changing lighting conditions. In this paper we develop techniques for inner lip feature extraction using a matching function based on a color module and a gradient module. Our numerical results show that the extraction using both modules outperforms that with color module only. From the extracted continuous lip contours, facial animation parameters (FAP) are extracted which are used to drive an MPEG-4 decoder. FAP are also applied in our audio-visual automatic speech recognition (AV-ASR) system to improve the recognition rate.
Keywords :
computer animation; decoding; face recognition; feature extraction; gradient methods; image colour analysis; image matching; speech recognition; tracking; AV-ASR system; MPEG-4 decoder; audio-visual automatic speech recognition; color module; continuous lip contours; facial animation parameters; gradient module; inner lip feature extraction; matching function; mouth tracking; recognition rate; Application software; Automatic speech recognition; Face recognition; Facial animation; Feature extraction; Financial advantage program; Human computer interaction; MPEG 4 Standard; Mouth; Speech recognition;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on
Print_ISBN :
0-7803-8484-9
DOI :
10.1109/ICASSP.2004.1326624