Title :
Implementation and its application of an algorithm of word segmentation on full text match in Chinese
Author :
Huifang, M A ; Houqin, S U
Author_Institution :
School of Computer Science & Technology, Donghua University, Shanghai, China 200051
Abstract :
Chinese word segmentation is the basis of Chinese information processing. The studied achievements about Chinese word segmentation have been summarized in brief in this paper from the basic theory of word segmentation. A binary word segmentation algorithm based on word dictionary has been chosen and studied by combing actual requirements to match Chinese description texts of the transaction projects for supply and requirement on e-Commerce, and an actual automatic matching system has been also designed and implemented by using the binary word segmentation algorithm and combing the techniques of pattern match and etc.
Keywords :
Algorithm design and analysis; Computational linguistics; Dictionaries; Indexes; Information processing; Java; Noise; binary word segmentation algorithm; full text match; reversed index; transaction match for supply and requirement; word dictionary;
Conference_Titel :
E -Business and E -Government (ICEE), 2011 International Conference on
Conference_Location :
Shanghai, China
Print_ISBN :
978-1-4244-8691-5
DOI :
10.1109/ICEBEG.2011.5882368
