• DocumentCode
    2270008
  • Title

    Chinese Unknown Word Recognition Based on Functional Applications of Type Theory

  • Author

    Gao, Dongping ; Niu, Zhendong ; Lv, Lening ; Jiang, Peng ; Qin, Xiao ; Guo, Jiahong

  • Author_Institution
    Sch. of Comput. Sci. & Technol., Beijing Inst. of Technol., Beijing
  • Volume
    3
  • fYear
    2008
  • fDate
    20-22 Dec. 2008
  • Firstpage
    498
  • Lastpage
    502
  • Abstract
    We introduce a method based on type functional applications for unknown word recognition in Chinese texts. A major advantage of the method is that it has an ability to detect unknown words of unrestricted characters by calculating the results of type functional applications. The method is built upon the basic type theory. It can take more semantic information while analyzing sentential syntactic structures in this method. In our approach, each word is assigned a type. By type functional applications, union algorithm and type-revivification; we can get the right segmentations of unknown words. It was applied to a newspaper of people daily, achieving 89.96% recall for person names, 77.94% recall for place names and more than 73% recall for other unknown words.
  • Keywords
    character recognition; computational linguistics; natural languages; text analysis; type theory; Chinese unknown word recognition; semantic information; sentential syntactic structures; type functional applications; type-revivification; union algorithm; Application software; Cities and towns; Computer science; Information analysis; Information technology; Sociology; Statistical analysis; Tagging; Text recognition; White spaces; Chinese Segmentations; Functional Applications; Type Theory; Unknown Word Recognition;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Intelligent Information Technology Application, 2008. IITA '08. Second International Symposium on
  • Conference_Location
    Shanghai
  • Print_ISBN
    978-0-7695-3497-8
  • Type

    conf

  • DOI
    10.1109/IITA.2008.378
  • Filename
    4740047