Title :
Towards a More Accurate Knowledge Level Estimation
Author :
Kardan, Samad ; Kardan, Ahmad
Author_Institution :
Comput. Eng. & Inf. Technol. Dept., Amirkabir Univ. of Technol., Amirkabir
Abstract :
Adaptive testing or Computer Adaptive Testing (CAT), adjusts the set of questions to the learnerpsilas estimated ability level, in order to reduce the guessing or slipping in answering too difficult or too easy questions. But the accuracy and fairness of this kind of assessment can be questioned. In this paper we presented a new approach for adapted assessment, in which the fixed set of questions is scored adaptively to maintain the benefits of adaptive testing while improving the fairness and accuracy. A dedicated Bayesian Network model is used to address the guessing and slipping, according to the estimated learnerpsilas level of knowledge and the difficulty level of the questions. The proposed system was implemented and used to estimate studentspsila level of knowledge in a virtual course. Then its accuracy was tested by predicting scores of students in a conventional exam. The results are promising and encourage further development of this method.
Keywords :
belief networks; computer aided instruction; educational administrative data processing; educational courses; Bayesian network model; adapted assessment; computer adaptive testing; conventional exam; e-learning system; educational course; guess-slip problem; question model; student knowledge level estimation; Bayesian methods; Electronic learning; Information technology; Knowledge engineering; System testing; Uncertainty; Adapted Assessment; Adaptive Testing; Bayesian Knowledge Model; CAT;
Conference_Titel :
Information Technology: New Generations, 2009. ITNG '09. Sixth International Conference on
Conference_Location :
Las Vegas, NV
Print_ISBN :
978-1-4244-3770-2
Electronic_ISBN :
978-0-7695-3596-8
DOI :
10.1109/ITNG.2009.154