Title :
ASR error detection in a conversational spoken language translation system
Author :
Wei Chen ; Ananthakrishnan, S. ; Kumar, Ravindra ; Prasad, Ranga ; Natarajan, Prem
Author_Institution :
Speech, Language, & Multimedia Process. Unit, Raytheon BBN Technol., Cambridge, MA, USA
Abstract :
Detection of automatic speech recognition (ASR) errors is crucial to preventing their further propagation through statistical machine translation (SMT) in conversational spoken language translation (CSLT) systems. In this paper, we venture beyond traditional features obtained from the ASR decoder and hypothesized word sequence, and explore additional information streams provided by an error-robust CSLT system, including SMT confidence estimates and posteriors from named entity detection (NED). Another significant novelty of this work is the use of an automated word boundary detector based on acoustic-prosodic features to verify the existence of ASR-hypothesized word boundaries, which further improves ASR error detection. Offline evaluation on a test set designed to invoke ASR errors showed that at 10% false alarm rate, the proposed features provide 2.8% absolute (4.2% relative) improvement in detection rate over a state-of-the-art baseline error detector that uses a rich set of features traditionally employed in the existing literature.
Keywords :
language translation; speech recognition; statistical analysis; ASR decoder; NED; SMT confidence; acoustic-prosodic features; automated word boundary detector; automatic speech recognition error detection; baseline error detector; conversational spoken language translation system; detection rate improvement; error-robust CSLT system; false alarm rate; hypothesized word sequence; information streams; named entity detection; statistical machine translation; Acoustics; Decoding; Detectors; Feature extraction; Speech; Speech recognition; Training; ASR error detection; SMT confidence estimation; automatic speech recognition; conversational speech translation; word boundary detection;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on
Conference_Location :
Vancouver, BC
DOI :
10.1109/ICASSP.2013.6639104