Title :
Efficient computation of confidence intervals forword error rates
Author :
Vilar, Juan Miguel
Author_Institution :
Dept. de Lenguajes y Sist. Informaticos, Univ. Jaume I, Castellon
fDate :
March 31 2008-April 4 2008
Abstract :
Word error rate is a standard measure of quality for different tasks such as speech recognition, OCR or machine translation. As such, it is important to compute it together with confidence intervals. Previous works in the literature employ Monte Carlo methods in order to compute those intervals. We show how to compute them without simulations. We also adapt a method that compares two systems over the same test data so that it can be used without simulations.
Keywords :
error statistics; language translation; optical character recognition; speech recognition; Monte Carlo methods; OCR; confidence intervals; machine translation; speech recognition; word error rates; Computational modeling; Distributed computing; Error analysis; Length measurement; Measurement standards; Optical character recognition software; Random variables; Sampling methods; Speech recognition; System testing; error analysis; word error rate;
Conference_Titel :
Acoustics, Speech and Signal Processing, 2008. ICASSP 2008. IEEE International Conference on
Conference_Location :
Las Vegas, NV
Print_ISBN :
978-1-4244-1483-3
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2008.4518806