Title :
A new language model adaptation framework using modification of structures of background corpus and language model
Author :
Lv, Zhenyu ; Liu, Wenju ; Yang, Zhanlei
Author_Institution :
Inst. of Autom., Chinese Acad. of Sci., Beijing, China
Abstract :
This paper presents a new framework of language model adaptation based on modification of structures of background corpus and language model. The widely used adaptation approach such as Linear Interpolation Method (LI) and Minimum Discrimination Information (MDI) method are used as the approaches to modify structure of trained background language model in new framework, while Maximum A Posteriori approach (MAP) is used as the method of modifying structure of background corpus. Experiments show that both techniques in the framework yield a significant reduction in perplexity over LI, MAP and MDI method in general adaptation framework about 5.2%, 12.2% and 36.8% respectively.
Keywords :
interpolation; maximum likelihood estimation; natural language processing; background corpus; linear interpolation method; maximum a posteriori approach; minimum discrimination information; new language model adaptation; Adaptation model; Automatic speech recognition; Automation; Cache memory; Data mining; Frequency; Interpolation; Natural languages; Probability; Yield estimation; Language model adaptation; MAP; MDI; linear interpolation; modification;
Conference_Titel :
Natural Language Processing and Knowledge Engineering, 2009. NLP-KE 2009. International Conference on
Conference_Location :
Dalian
Print_ISBN :
978-1-4244-4538-7
Electronic_ISBN :
978-1-4244-4540-0
DOI :
10.1109/NLPKE.2009.5313748