Title :
Arabic Named Entity Recognition: A Feature-Driven Study
Author :
Benajiba, Yassine ; Diab, Mona ; Rosso, Paolo
Author_Institution :
Dept. of Informatic Syst., Polytech. Univ. of Valencia, Valencia
fDate :
7/1/2009 12:00:00 AM
Abstract :
The named entity recognition task aims at identifying and classifying named entities within an open-domain text. This task has been garnering significant attention recently as it has been shown to help improve the performance of many natural language processing applications. In this paper, we investigate the impact of using different sets of features in three discriminative machine learning frameworks, namely, support vector machines, maximum entropy and conditional random fields for the task of named entity recognition. Our language of interest is Arabic. We explore lexical, contextual and morphological features and nine data-sets of different genres and annotations. We measure the impact of the different features in isolation and incrementally combine them in order to evaluate the robustness to noise of each approach. We achieve the highest performance using a combination of 15 features in conditional random fields using broadcast news data (Fbeta = 1=83.34).
Keywords :
character recognition; information retrieval; learning (artificial intelligence); maximum entropy methods; natural language processing; support vector machines; broadcast news data; conditional random fields; machine learning; maximum entropy methods; named entity recognition; natural language processing; open-domain text; support vector machines; Broadcasting; Entropy; Frequency; Information retrieval; Machine learning; Natural language processing; Noise measurement; Noise robustness; Support vector machines; Text recognition; Arabic; machine learning comparison; named entity recognition; natural language processing (NLP);
Journal_Title :
Audio, Speech, and Language Processing, IEEE Transactions on
DOI :
10.1109/TASL.2009.2019927