• DocumentCode
    2259270
  • Title

    A new language model adaptation framework using modification of structures of background corpus and language model

  • Author

    Lv, Zhenyu ; Liu, Wenju ; Yang, Zhanlei

  • Author_Institution
    Inst. of Autom., Chinese Acad. of Sci., Beijing, China
  • fYear
    2009
  • fDate
    24-27 Sept. 2009
  • Firstpage
    1
  • Lastpage
    4
  • Abstract
    This paper presents a new framework of language model adaptation based on modification of structures of background corpus and language model. The widely used adaptation approach such as Linear Interpolation Method (LI) and Minimum Discrimination Information (MDI) method are used as the approaches to modify structure of trained background language model in new framework, while Maximum A Posteriori approach (MAP) is used as the method of modifying structure of background corpus. Experiments show that both techniques in the framework yield a significant reduction in perplexity over LI, MAP and MDI method in general adaptation framework about 5.2%, 12.2% and 36.8% respectively.
  • Keywords
    interpolation; maximum likelihood estimation; natural language processing; background corpus; linear interpolation method; maximum a posteriori approach; minimum discrimination information; new language model adaptation; Adaptation model; Automatic speech recognition; Automation; Cache memory; Data mining; Frequency; Interpolation; Natural languages; Probability; Yield estimation; Language model adaptation; MAP; MDI; linear interpolation; modification;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Natural Language Processing and Knowledge Engineering, 2009. NLP-KE 2009. International Conference on
  • Conference_Location
    Dalian
  • Print_ISBN
    978-1-4244-4538-7
  • Electronic_ISBN
    978-1-4244-4540-0
  • Type

    conf

  • DOI
    10.1109/NLPKE.2009.5313748
  • Filename
    5313748