• DocumentCode
    2026238
  • Title

    Resolution to Chinese combinational ambiguity combined corpus-based method with linguistics knowledge

  • Author

    Liu, JiangYang ; Liu, Ying

  • Author_Institution
    Dept. of Chinese Language & Literature, Tsinghua Univ., Beijing, China
  • Volume
    3
  • fYear
    2010
  • fDate
    10-12 Aug. 2010
  • Firstpage
    1469
  • Lastpage
    1473
  • Abstract
    Combinational ambiguity is a challenging issue in Chinese word segmentation in that its disambiguation depends on the contextual information. This paper collects contextual information of 28 typical combinational ambiguity strings, and makes use of lexical, syntactic and semantic knowledge and large scale corpus to summarize the rules of these combinational ambiguity strings. Using these rules to test “People´s Daily” Corpus of 1996, we find that the average precision rate is improved from 80.65% to 94.95%. The result shows that using rules is effective for disambiguation.
  • Keywords
    natural language processing; word processing; Chinese combinational ambiguity; Chinese word segmentation; combinational ambiguity strings; contextual information; corpus based method; linguistic knowledge; semantic knowledge; Computers; Context; Pragmatics; Presses; Semantics; Syntactics; Tagging; combinational ambiguity; linguistic knowledge; rules;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Fuzzy Systems and Knowledge Discovery (FSKD), 2010 Seventh International Conference on
  • Conference_Location
    Yantai, Shandong
  • Print_ISBN
    978-1-4244-5931-5
  • Type

    conf

  • DOI
    10.1109/FSKD.2010.5569209
  • Filename
    5569209