DocumentCode
2259270
Title
A new language model adaptation framework using modification of structures of background corpus and language model
Author
Lv, Zhenyu ; Liu, Wenju ; Yang, Zhanlei
Author_Institution
Inst. of Autom., Chinese Acad. of Sci., Beijing, China
fYear
2009
fDate
24-27 Sept. 2009
Firstpage
1
Lastpage
4
Abstract
This paper presents a new framework of language model adaptation based on modification of structures of background corpus and language model. The widely used adaptation approach such as Linear Interpolation Method (LI) and Minimum Discrimination Information (MDI) method are used as the approaches to modify structure of trained background language model in new framework, while Maximum A Posteriori approach (MAP) is used as the method of modifying structure of background corpus. Experiments show that both techniques in the framework yield a significant reduction in perplexity over LI, MAP and MDI method in general adaptation framework about 5.2%, 12.2% and 36.8% respectively.
Keywords
interpolation; maximum likelihood estimation; natural language processing; background corpus; linear interpolation method; maximum a posteriori approach; minimum discrimination information; new language model adaptation; Adaptation model; Automatic speech recognition; Automation; Cache memory; Data mining; Frequency; Interpolation; Natural languages; Probability; Yield estimation; Language model adaptation; MAP; MDI; linear interpolation; modification;
fLanguage
English
Publisher
ieee
Conference_Titel
Natural Language Processing and Knowledge Engineering, 2009. NLP-KE 2009. International Conference on
Conference_Location
Dalian
Print_ISBN
978-1-4244-4538-7
Electronic_ISBN
978-1-4244-4540-0
Type
conf
DOI
10.1109/NLPKE.2009.5313748
Filename
5313748
Link To Document