• DocumentCode
    1076763
  • Title

    Arabic Named Entity Recognition: A Feature-Driven Study

  • Author

    Benajiba, Yassine ; Diab, Mona ; Rosso, Paolo

  • Author_Institution
    Dept. of Informatic Syst., Polytech. Univ. of Valencia, Valencia
  • Volume
    17
  • Issue
    5
  • fYear
    2009
  • fDate
    7/1/2009 12:00:00 AM
  • Firstpage
    926
  • Lastpage
    934
  • Abstract
    The named entity recognition task aims at identifying and classifying named entities within an open-domain text. This task has been garnering significant attention recently as it has been shown to help improve the performance of many natural language processing applications. In this paper, we investigate the impact of using different sets of features in three discriminative machine learning frameworks, namely, support vector machines, maximum entropy and conditional random fields for the task of named entity recognition. Our language of interest is Arabic. We explore lexical, contextual and morphological features and nine data-sets of different genres and annotations. We measure the impact of the different features in isolation and incrementally combine them in order to evaluate the robustness to noise of each approach. We achieve the highest performance using a combination of 15 features in conditional random fields using broadcast news data (Fbeta = 1=83.34).
  • Keywords
    character recognition; information retrieval; learning (artificial intelligence); maximum entropy methods; natural language processing; support vector machines; broadcast news data; conditional random fields; machine learning; maximum entropy methods; named entity recognition; natural language processing; open-domain text; support vector machines; Broadcasting; Entropy; Frequency; Information retrieval; Machine learning; Natural language processing; Noise measurement; Noise robustness; Support vector machines; Text recognition; Arabic; machine learning comparison; named entity recognition; natural language processing (NLP);
  • fLanguage
    English
  • Journal_Title
    Audio, Speech, and Language Processing, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1558-7916
  • Type

    jour

  • DOI
    10.1109/TASL.2009.2019927
  • Filename
    5075781