Title :
A method and application of automatic term extraction using conditional random fields
Author :
Fu, Weijun ; Li, Lei
Author_Institution :
CISTR, Beijing Univ. of Posts & Telecommun., Beijing, China
Abstract :
A conditional random fields (CRF) based method and application of automatic term extraction was proposed in this paper according to the theory of ldquoInformation -Knowledge - Intelligencerdquo transformation. A CRF model was created by training the different fields of the corpus segmented and tagged. Using the model trained by CRF, the documents in a given field were automatically tagged and the terms in the field was automatically extracted with a certain way. On this basis, this method was used in automatic text summarization system to enhance the rate of the excellent summary. The experimental results showed that this method had a relatively high recall rate and accuracy, could effectively increase the performance of automatic summarization system.
Keywords :
information retrieval; random processes; text analysis; automatic term extraction; automatic text summarization system; conditional random; information-knowledge-intelligence transformation; Data mining; Entropy; Graphical models; Hidden Markov models; Information processing; Information retrieval; Machine intelligence; Random variables; Standardization; Terminology; Automatic Term Extraction; Automatic Text Summarization; Conditional Random Fields;
Conference_Titel :
Natural Language Processing and Knowledge Engineering, 2009. NLP-KE 2009. International Conference on
Conference_Location :
Dalian
Print_ISBN :
978-1-4244-4538-7
Electronic_ISBN :
978-1-4244-4540-0
DOI :
10.1109/NLPKE.2009.5313740