• DocumentCode
    3424707
  • Title

    Probabilistic unsupervised Chinese sentence compression

  • Author

    Chen, Jinguang ; He, Tingting ; Gui, Zhuoming ; Li, Fang

  • Author_Institution
    Eng. & Res. Center for Inf. Technol. on Educ., Huazhong Normal Univ., Wuhan, China
  • fYear
    2009
  • fDate
    17-19 Aug. 2009
  • Firstpage
    61
  • Lastpage
    66
  • Abstract
    Research on sentence compression has been undergoing for many years in other languages, especially in English, but research on Chinese sentence compression is rarely found. In this paper, we describe an efficient probabilistic and syntactic approach to Chinese sentence compression. We introduce the classical noisy-channel approach into Chinese sentence compression and improve it in many ways. Since there is no parallel training corpus in Chinese, we use the unsupervised learning method. This paper also presents a novel bottom-up optimizing algorithm which considers both bigram and syntactic probabilities for generating candidate compressed sentences. We evaluate results against manual compressions and a simple baseline. The experiments show the effectiveness of the proposed approach.
  • Keywords
    data compression; natural language processing; statistical distributions; unsupervised learning; Chinese sentence compression; classical noisy-channel approach; probabilistic approach; syntactic approach; unsupervised learning method; Computer science; Computer science education; Context modeling; Data mining; Educational institutions; Educational technology; Information technology; Natural languages; Optimization methods; Unsupervised learning;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Granular Computing, 2009, GRC '09. IEEE International Conference on
  • Conference_Location
    Nanchang
  • Print_ISBN
    978-1-4244-4830-2
  • Type

    conf

  • DOI
    10.1109/GRC.2009.5255158
  • Filename
    5255158