• DocumentCode
    1798199
  • Title

    Semantic Similarity Based Approach for Automatic Evaluation of Free Text Answers Using Link Grammar

  • Author

    Chakraborty, Udit Kr ; Gurung, Rashmi ; Roy, Sandip

  • Author_Institution
    Dept. of Comput. Sci. & Eng., Sikkim Manipal Inst. of Technol., Manipal, India
  • fYear
    2014
  • fDate
    18-21 Dec. 2014
  • Firstpage
    218
  • Lastpage
    221
  • Abstract
    Most approaches towards automatic evaluation of free text answers are keyword centric. Though keywords essentially reflect and represent the primary concept coverage of an answer, they are incomplete without the associated texts. The words occurring before and after the keywords bring out the true meaning. The work presented in this paper proposes a semantic similarity based approach for evaluation of free text answers where both keywords and the associated text contribute to the score. A link grammar based approach is used to extract the keywords from the answer and through the process of identifying and extracting the relational expressions for a keyword the model automatically evaluates a learners´ free text response SA to a given question Q with respect to a model answer MA. The score of the automated system have a high co-relation with human evaluator score as can be found from the reported results.
  • Keywords
    context-free grammars; natural language processing; question answering (information retrieval); automatic evaluation; free text answers; free text response; human evaluator score; link grammar-based approach; semantic similarity; Computers; Couplings; Grammar; Hardware; Operating systems; Semantics; Speech; evaluation; keyword; learners´ response; link grammar; relational expression; semantic similarity;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Technology for Education (T4E), 2014 IEEE Sixth International Conference on
  • Conference_Location
    Clappana
  • Type

    conf

  • DOI
    10.1109/T4E.2014.57
  • Filename
    7009576