Title :
Temporal alignment algorithm for electropalatographic and acoustic signals in long utterances
Author :
Yinghao, Li ; Xiaosheng, Pan
Author_Institution :
Foreign Languages Coll., Yanbian Univ., Yanji, China
Abstract :
The lack of temporal alignment between simultaneously recorded electropalatographic (EPG) and acoustic signal, recorded through different channels with different sampling frequencies, was detected for longer stretches of speech. The temporal length for the EPG signal was normally shorter than that for the acoustic signal. Corpus-based examination found that the length variation of the acoustic signal was as a linear correlation with the temporal length difference between the two signals. The lack of synchronicity between the articulatory and acoustic events was assumed to be attributed more to the non-synchronized clocks in audio and EPG acquisition devices than the reason that multiple marked palate signals appeared at the beginning of the signal. The temporal alignment algorithm for the two signals was proposed and the Matlab program was developed for serving this purpose. Two realizations of the algorithm were tested and the results were discussed regarding the usefulness in the speech research and articulatory modeling.
Keywords :
acoustic signal processing; audio signal processing; correlation methods; signal sampling; speech synthesis; EPG acquisition devices; Matlab program; acoustic events; acoustic signal length variation; articulatory events; articulatory modeling; audio devices; corpus-based examination; electropalatographic signals; linear correlation; long utterances; multiple marked palate signals; nonsynchronized clocks; sampling frequency; speech production; speech research; synchronicity; temporal alignment algorithm; temporal length difference; temporal signal length; Acoustics; Clocks; Computers; Correlation; Educational institutions; MATLAB; Speech;
Conference_Titel :
Audio, Language and Image Processing (ICALIP), 2012 International Conference on
Conference_Location :
Shanghai
Print_ISBN :
978-1-4673-0173-2
DOI :
10.1109/ICALIP.2012.6376752