DocumentCode
2767814
Title
A Model for Chinese Sentence Ordering Based on Markov Model
Author
He, Yanxiang ; Peng, Gongfu ; Wen, Weidong
Author_Institution
Dept. of Comput. Sci. & Technol., Wuhan Univ., Wuhan, China
Volume
7
fYear
2009
fDate
14-16 Aug. 2009
Firstpage
457
Lastpage
461
Abstract
In this paper, we discuss a method to improve the sentence ordering task in Chinese. The way we approach is based on the analysis of Markov model, which can train transition probability in raw corpus. We iteratively calculate the largest transition probability path in Markov model to confirm the correct order. The method avoids judging the first sentence, which could lead to an instable result in our early work. We also provide a way to evaluate the effect of experiments. Experimental results indicate that our method shows good results on accuracy, and significantly improves the readability and coherence of the article. The method could be used in various fields of Chinese text processing work and applications.
Keywords
Markov processes; natural language processing; probability; text analysis; word processing; Chinese sentence ordering; Chinese text processing; Markov model; sentence ordering task; transition probability path; Application software; Coherence; Computer science; Data mining; Fuzzy systems; Helium; Humans; Information analysis; Probability; Text processing; Markov model; sentence ordering;
fLanguage
English
Publisher
ieee
Conference_Titel
Fuzzy Systems and Knowledge Discovery, 2009. FSKD '09. Sixth International Conference on
Conference_Location
Tianjin
Print_ISBN
978-0-7695-3735-1
Type
conf
DOI
10.1109/FSKD.2009.489
Filename
5360052
Link To Document