DocumentCode
1665592
Title
Analysis of visual speech signatures
Author
Sadaghiani, Mohammad Hossein ; Annaz, Fawaz Yahya
fYear
2012
Firstpage
21
Lastpage
26
Abstract
The visual components of speech are the subject of research in resent years. The motivation of this paper is to suggest the concept of signature for visualized speech. These visual signatures are defined for basic components of mouth movement corresponding to sound units. Therefore, an accurate and unified database for perception and generation of visual speech could be organized. Toward this aim, mathematical tools and processes are suggested for concluding the speech related visual units. The lip geometry is parameterized with feature points. The main interpolation tool has been chosen as the Barycentric Lagrange interpolation (BLI). It can include the mouth geometry´s structure dynamically during articulation in mathematical form. The outcomes (experimental models) of proposed approach associate mathematical expressions. Such method could be successor of lip tracking and identification algorithm in both lip reading and visual speech animation systems.
Keywords
computational geometry; computer animation; interpolation; object tracking; speech processing; visual perception; articulation; associate mathematical expressions; barycentric Lagrange interpolation tool; feature points; lip geometry; lip identification algorithm; lip tracking algorithm; mathematical tools; mouth geometry structure; mouth movement; reading speech animation systems; sound units; speech related visual units; speech visual components; visual speech animation systems; visual speech generation; visual speech perception; visual speech signature analysis; Animation; Feature extraction; Interpolation; Mouth; Polynomials; Speech; Visualization; The Lagrange interpolation; Viseme; the Barycentric Lagrange Interpolation;
fLanguage
English
Publisher
ieee
Conference_Titel
Engineering Education (ICEED), 2012 4th International Congress on
Conference_Location
Georgetown
Print_ISBN
978-1-4673-4867-6
Type
conf
DOI
10.1109/ICEED.2012.6779263
Filename
6779263
Link To Document