Title :
Dictionary Chinese Word Segmentation research a method combined with CRFs
Author :
Wang, Chengliang ; Chen, Juanjuan ; Wu, Xichuan
Author_Institution :
Coll. of Comput. Sci. & Eng., Chongqing Univ., Chongqing, China
fDate :
Nov. 30 2010-Dec. 2 2010
Abstract :
The Word Segmentation of matching literal based on Chinese Dictionary cannot resolve the problem of segmenting ambiguity and combinatorial ambiguity. Based on the dictionary segmentation, this paper proposes a method of Dictionary Chinese Word Segmentation combined with CRFs. It is proved that this method can have better performance than CRFs segmentation and traditional dictionary segmentation.
Keywords :
dictionaries; natural language processing; random processes; word processing; CRF; combinatorial ambiguity; conditional random field model; dictionary Chinese word segmentation; segmenting ambiguity; Accuracy; Dictionaries; Equations; Hidden Markov models; Labeling; Mathematical model; Viterbi algorithm; CRFs; combinatorial ambiguity; matching literal; segmenting ambiguity; word segmentation;
Conference_Titel :
Computer Sciences and Convergence Information Technology (ICCIT), 2010 5th International Conference on
Conference_Location :
Seoul
Print_ISBN :
978-1-4244-8567-3
Electronic_ISBN :
978-89-88678-30-5
DOI :
10.1109/ICCIT.2010.5711199
