Title :
Time warping of audio signals
Author :
Goldenstein, Siome ; Gomes, Jonas
Author_Institution :
VAST Lab, Pennsylvania Univ., Philadelphia, PA, USA
Abstract :
Describes a technique to obtain a time dilation or contraction of an audio signal. Different computer graphics applications can take advantage of this technique. In real-time networked virtual reality applications, such as teleconferences or games, the audio might be transmitted independently from the rest of the data. These different signals arrive asynchronously and need to be somehow resynchronized on-the-fly. In animation, it can help to automatically fit and merge pre-recorded sound samples to special timed events. It also makes it easier to accomplish special effects, like lip-sync for dubbing or changing the voice of an animated character. Our technique tries to eliminate distortions by the replication of the original signal frequencies. Malvar wavelets are used to avoid clicking between segment transitions
Keywords :
audio signal processing; computer animation; multimedia computing; real-time systems; speech processing; synchronisation; time-frequency analysis; virtual reality; wavelet transforms; Malvar wavelets; animated characters; animation; asynchronously arriving signals; audio signal time warping; audio transformation; audio-video synchronization; clicking; computer graphics applications; distortion elimination; dubbing; dynamical time warping; games; independently transmitted audio; lip synchronization; local cosine transform; pre-recorded sound sample fitting; real-time networked virtual reality applications; segment transitions; signal frequency replication; signal resynchronization; special effects; speech recognition; teleconferences; time contraction; time dilation; time-frequency manipulation; timed events; voice changing; Wavelet transforms;
Conference_Titel :
Computer Graphics International, 1999. Proceedings
Conference_Location :
Canmore, Alta.
Print_ISBN :
0-7695-0185-0
DOI :
10.1109/CGI.1999.777905