DocumentCode
1076763
Title
Arabic Named Entity Recognition: A Feature-Driven Study
Author
Benajiba, Yassine ; Diab, Mona ; Rosso, Paolo
Author_Institution
Dept. of Informatic Syst., Polytech. Univ. of Valencia, Valencia
Volume
17
Issue
5
fYear
2009
fDate
7/1/2009 12:00:00 AM
Firstpage
926
Lastpage
934
Abstract
The named entity recognition task aims at identifying and classifying named entities within an open-domain text. This task has been garnering significant attention recently as it has been shown to help improve the performance of many natural language processing applications. In this paper, we investigate the impact of using different sets of features in three discriminative machine learning frameworks, namely, support vector machines, maximum entropy and conditional random fields for the task of named entity recognition. Our language of interest is Arabic. We explore lexical, contextual and morphological features and nine data-sets of different genres and annotations. We measure the impact of the different features in isolation and incrementally combine them in order to evaluate the robustness to noise of each approach. We achieve the highest performance using a combination of 15 features in conditional random fields using broadcast news data (Fbeta = 1=83.34).
Keywords
character recognition; information retrieval; learning (artificial intelligence); maximum entropy methods; natural language processing; support vector machines; broadcast news data; conditional random fields; machine learning; maximum entropy methods; named entity recognition; natural language processing; open-domain text; support vector machines; Broadcasting; Entropy; Frequency; Information retrieval; Machine learning; Natural language processing; Noise measurement; Noise robustness; Support vector machines; Text recognition; Arabic; machine learning comparison; named entity recognition; natural language processing (NLP);
fLanguage
English
Journal_Title
Audio, Speech, and Language Processing, IEEE Transactions on
Publisher
ieee
ISSN
1558-7916
Type
jour
DOI
10.1109/TASL.2009.2019927
Filename
5075781
Link To Document