Title :
HMM-separation-based speech recognition for a distant moving speaker
Author :
Takiguchi, Tetsuya ; Nakamura, Satoshi ; Shikano, Kiyohiro
Author_Institution :
Tokyo Res. Lab., Kanagawa, Japan
fDate :
2/1/2001 12:00:00 AM
Abstract :
This paper presents a hands-free speech recognition method based on HMM composition and separation for speech contaminated not only by additive noise but also by an acoustic transfer function. The method realizes an improved user interface such that a user is not encumbered by microphone equipment in noisy and reverberant environments. The use of HMM composition has already been proposed for countering additive noise. In this paper, the same approach is extended to handle convolutional acoustic distortion in a reverberant room, by using an HMM to model the acoustic transfer function. The states of this HMM correspond to different positions of the sound source. It can represent the positions of the sound sources, even if the speaker moves. This paper also proposes a new method, HMM separation, for estimating the HMM parameters of the acoustic transfer function on the basis of a maximum likelihood manner. The proposed method is obtained through the reverse of the process of HMM composition, where the model parameters are estimated by maximizing the likelihood of adaptation data uttered from an unknown position. Therefore, measurement of impulse responses is not required. The paper also describes the performance of the proposed methods for recognizing real distant-talking speech. The results of experiments clarify the effectiveness of the proposed method
Keywords :
acoustic noise; architectural acoustics; hidden Markov models; maximum likelihood estimation; reverberation; speech recognition; transfer functions; HMM parameter estimation; HMM speech composition; HMM speech separation; HMM-separation-based speech recognition; MLE; acoustic transfer function; additive noise; convolutional acoustic distortion; distant moving speaker; hands-free speech recognition; maximum likelihood estimation; noisy environment; performance; real distant-talking speech; reverberant room; sound source; user interface; Acoustic noise; Additive noise; Hidden Markov models; Microphones; Parameter estimation; Speech enhancement; Speech recognition; Transfer functions; User interfaces; Working environment noise;
Journal_Title :
Speech and Audio Processing, IEEE Transactions on