DocumentCode
590256
Title
An unsupervised syntax disambiguation method combined with the context-sensitive probability
Author
Xu Li ; Chunlong Yao ; Lan Shen ; Li Shao
Author_Institution
Inf. Sci. & Eng. Coll., Dalian Polytech. Univ., Dalian, China
fYear
2012
fDate
Oct. 30 2012-Nov. 2 2012
Firstpage
1066
Lastpage
1070
Abstract
To address the limitations of probabilistic context free grammar, the context information is used and a probabilistic estimation function of syntax structure combined the cooccurrence information of part of speech and syntax category is proposed in this paper. The inside-outside algorithm is used to obtain the probabilities of the syntactic rules and the structure co-occurrences from the raw materials, which can address the bottleneck of supervised learning that large-scale treebank is expensive to create. The experimental results show that the proposed method can effectively improve the precision of syntax disambiguation.
Keywords
context-sensitive grammars; probability; speech processing; text analysis; tree data structures; unsupervised learning; co-occurrence information; context-sensitive probability; inside-outside algorithm; large-scale treebank; part of speech; probabilistic context free grammar; probabilistic estimation function; supervised learning; syntactic rule probability; syntax disambiguation precision improvement; syntax structure; unsupervised syntax disambiguation method; Context; Estimation; Grammar; Probabilistic logic; Probability; Speech; Syntactics;
fLanguage
English
Publisher
ieee
Conference_Titel
Information and Communication Technologies (WICT), 2012 World Congress on
Conference_Location
Trivandrum
Print_ISBN
978-1-4673-4806-5
Type
conf
DOI
10.1109/WICT.2012.6409233
Filename
6409233
Link To Document