Title :
Virtual Talk: a model-based virtual phone using a layered audio-visual integration
Author :
Chang, Yao-Jen ; Chen, Chih-Chung ; Chou, Jen-Chung ; Chen, Yung-Chang
Author_Institution :
Dept. of Electr. Eng., Nat. Tsing Hua Univ., Hsinchu, Taiwan
Abstract :
An implementation of a one-to-one model based virtual phone system, the Virtual Talk, is presented. In addition to the conventional ability of Internet phone applications to transmit speech messages between two users, the facial expressions of each user is real-time analyzed, transmitted, and synthesized in a model based approach. Thereby, a joint audiovisual communication can be achieved in less than 10 kbps. To resolve the problem of audio-visual synchronization, a layered architecture is also proposed for audio-visual integration
Keywords :
Internet telephony; audio-visual systems; multimedia communication; real-time systems; virtual reality; Internet phone applications; Virtual Talk; audio-visual synchronization; facial expressions; joint audiovisual communication; layered architecture; layered audio-visual integration; model based approach; one-to-one model based virtual phone system; real time analysis; speech messages; Application software; Cepstral analysis; Facial animation; Financial advantage program; MPEG 4 Standard; Performance analysis; Robot control; Speech analysis; Speech synthesis; Telephony;
Conference_Titel :
Multimedia and Expo, 2000. ICME 2000. 2000 IEEE International Conference on
Conference_Location :
New York, NY
Print_ISBN :
0-7803-6536-4
DOI :
10.1109/ICME.2000.869628
