Title :
Predicting Phrase-Level Tags Using Entropy Inspired Discriminative Models
Author :
Oh, Jin Young ; Han, Yo-Sub ; Park, Jungyeul ; Cha, Jeong-Won
Author_Institution :
Dept. of Comput. Eng., Changwon Nat. Univ., Changwon, South Korea
Abstract :
In this paper, we describe a system which predicts phrase-level tags for eojeols in Korean using entropy inspired discriminative probabilistic models such as a conditional random fields. Instead of selecting features by the intuition of user, we use a decision tree and error analysis systematically for selecting the best feature. Once we generate all available features from the corpus, then select features by using decision tree and error analysis iteratively. Experimental results show 93.90% and 49.46% accuracy for eojeols and sentences respectively. This accuracy eventually is able to improve further syntactic analysis results. We find from the results that the better meaningful features using systematic methods is good at raising performance.
Keywords :
decision trees; entropy; natural language processing; probability; Korean eojeols; conditional random fields; decision tree; entropy inspired discriminative probabilistic models; error analysis; phrase-level tag prediction; sentences; Accuracy; Context; Decision trees; Entropy; Error analysis; Syntactics; Training;
Conference_Titel :
Information Science and Applications (ICISA), 2011 International Conference on
Conference_Location :
Jeju Island
Print_ISBN :
978-1-4244-9222-0
Electronic_ISBN :
978-1-4244-9223-7
DOI :
10.1109/ICISA.2011.5772402