• DocumentCode
    2640586
  • Title

    A note on morphological analysis methods based on statistical decision theory

  • Author

    Maeda, Yasunari ; Ikeda, Naoya ; Yoshida, Hideki ; Fujiwara, Yoshitaka ; Matsushima, Toshiyasu

  • Author_Institution
    Kitami Inst. of Technol., Kitami
  • fYear
    2007
  • fDate
    17-20 Sept. 2007
  • Firstpage
    1563
  • Lastpage
    1568
  • Abstract
    Morphological analysis is one of important topics in the field of NLP(Natural Language Processing). In many previous research a HMM(Hidden Markov Model) with unknown parameters has been used as a language model. In this research we also use the HMM as the language model. And we assume that sate transitions in the HMM are dominated by a second order Markov chain. At first we propose two types of morphological analysis methods which minimize the error rate with reference to a Bayes criterion. But the computational complexity of the proposed Bayes optimal morphological analysis methods are exponential order. So we also propose approximate methods.
  • Keywords
    computational complexity; hidden Markov models; natural language processing; statistical analysis; Bayes criterion; HMM; hidden Markov model; morphological analysis methods; natural language processing; second order Markov chain; statistical decision theory; Computational complexity; Decision theory; Error analysis; Hidden Markov models; Mathematics; Parameter estimation; Performance analysis; Probability; Speech analysis; State estimation; hidden markov model; morphological analysis; statistical decision theory;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    SICE, 2007 Annual Conference
  • Conference_Location
    Takamatsu
  • Print_ISBN
    978-4-907764-27-2
  • Electronic_ISBN
    978-4-907764-27-2
  • Type

    conf

  • DOI
    10.1109/SICE.2007.4421232
  • Filename
    4421232