DocumentCode :
2270008
Title :
Chinese Unknown Word Recognition Based on Functional Applications of Type Theory
Author :
Gao, Dongping ; Niu, Zhendong ; Lv, Lening ; Jiang, Peng ; Qin, Xiao ; Guo, Jiahong
Author_Institution :
Sch. of Comput. Sci. & Technol., Beijing Inst. of Technol., Beijing
Volume :
3
fYear :
2008
fDate :
20-22 Dec. 2008
Firstpage :
498
Lastpage :
502
Abstract :
We introduce a method based on type functional applications for unknown word recognition in Chinese texts. A major advantage of the method is that it has an ability to detect unknown words of unrestricted characters by calculating the results of type functional applications. The method is built upon the basic type theory. It can take more semantic information while analyzing sentential syntactic structures in this method. In our approach, each word is assigned a type. By type functional applications, union algorithm and type-revivification; we can get the right segmentations of unknown words. It was applied to a newspaper of people daily, achieving 89.96% recall for person names, 77.94% recall for place names and more than 73% recall for other unknown words.
Keywords :
character recognition; computational linguistics; natural languages; text analysis; type theory; Chinese unknown word recognition; semantic information; sentential syntactic structures; type functional applications; type-revivification; union algorithm; Application software; Cities and towns; Computer science; Information analysis; Information technology; Sociology; Statistical analysis; Tagging; Text recognition; White spaces; Chinese Segmentations; Functional Applications; Type Theory; Unknown Word Recognition;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Intelligent Information Technology Application, 2008. IITA '08. Second International Symposium on
Conference_Location :
Shanghai
Print_ISBN :
978-0-7695-3497-8
Type :
conf
DOI :
10.1109/IITA.2008.378
Filename :
4740047
Link To Document :
بازگشت