Text-driven automatic image sequence generation using facial modeling for digital TV news production system

Author

Cheung, Cliun-Ho ; Wong, Hon-Wah ; Po, Lai-Man

Author_Institution

Dept. of Electron. Eng., City Univ. of Hong Kong, Hong Kong

Volume

2

fYear

1997

fDate

9-12 Jun 1997

Firstpage

1409

Abstract

This paper presents a facial modeling approach for automating the head-and-shoulder image sequence generation for digital TV news video clips production which is the most expensive part in terms of manpower and cost. With the IPA phonetics transcribed from news script being the driving parameter, the high precision adapted 2-D wireframe model on a frontal view of speaker image with sufficient facial textural information will be used to define the associated facial action units (AFAUs) corresponding to the phonemes. This developed facial modeling approach increases the intelligibility of facial non-verbal communication for potential audiovisual lip-synch application like TV news video clips, video telephony, Story Teller On Demand (STOD), lip-reading for the deaf or the hearing-impaired

Keywords

computer animation; image sequences; image texture; television production; video coding; 2D wireframe model; IPA phonetics; Story Teller On Demand; associated facial action units; audiovisual lip-synch application; digital TV news production system; facial modeling; facial textural information; lip-reading; text-driven automatic image sequence generation; video clips; video telephony; Digital TV; Facial animation; Image coding; Image generation; Image sequences; Libraries; Natural languages; Production systems; Speech synthesis; Video on demand;

fLanguage

English

Publisher

ieee

Conference_Titel

Circuits and Systems, 1997. ISCAS '97., Proceedings of 1997 IEEE International Symposium on

Print_ISBN

0-7803-3583-X

Type

conf

DOI

10.1109/ISCAS.1997.622161

Filename

622161