Title :
A method of estimating the equal error rate for automatic speaker verification
Author :
Cheng, Jyh-Min ; Wang, Hsiao-Chuan
Author_Institution :
Dept. of Electr. Eng., Nat. Tsing Hua Univ., Hsinchu, Taiwan
Abstract :
In an automatic speaker verification (ASV) system, the equal error rate (EER) is a measure to evaluate the system performance. Usually it needs a large number of testing samples to calculate the EER. In order to estimate the EER without running the experiments using testing samples, a method of model-based EER estimation which computes likelihood scores directly from client speaker models and imposter models is proposed. However, the distribution of the computed likelihood scores is significantly biased against the distribution of likelihood scores obtained from testing samples. Here we propose a novel idea to manipulate the speaker models of the client speakers and the imposters so that the distribution of the computed likelihood scores is closer to the distribution of likelihood scores obtained from testing samples. Then a more reliable EER can be calculated by the speaker models. The experimental results show that the proposed method can properly estimate the EER.
Keywords :
error statistics; maximum likelihood estimation; speaker recognition; statistical distributions; automatic speaker verification; client speaker models; equal error rate; imposter models; likelihood score distribution; model-based EER estimation; system performance; Automatic speech recognition; Distributed computing; Error analysis; Estimation error; Hidden Markov models; NIST; Runtime; System performance; System testing; Vocabulary;
Conference_Titel :
Chinese Spoken Language Processing, 2004 International Symposium on
Print_ISBN :
0-7803-8678-7
DOI :
10.1109/CHINSL.2004.1409642