Title :
An Optimization Algorithm of Chinese Word Segmentation Based on Dictionary
Author :
Jun Tang;Qing Wu;Yinghong Li
Author_Institution :
Inf. Manage. Dept., Yunnan Tobacco Ind. Co., Ltd., Kunming, China
Abstract :
Analyzing the system of several Chinese word segmentation algorithms for the current existing problems, we design and construct a new dictionary mechanism. We present a segmentation algorithm, forward maximum matching method that adding 1 word each time and self-define the IDC function as disambiguation algorithm to achieve a relatively complete system of experimental Chinese word segmentation. By comparing the simulation results of the traditional methods to the forward maximum matching algorithm proposed in this thesis can be obtained a higher rate segmentation, as well as IDC disambiguation function also has better performance.
Keywords :
"Dictionaries","Accuracy","Algorithm design and analysis","Optimization","Computers","Monitoring","Simulation"
Conference_Titel :
Network and Information Systems for Computers (ICNISC), 2015 International Conference on
DOI :
10.1109/ICNISC.2015.109