شماره ركورد :
1128094
عنوان مقاله :
مقايسه روش آنگوف مبتني بر IRT و روش بوكمارك در تعيين استاندارد چيرگي آزمون زبان MSRT
عنوان به زبان ديگر :
Comparison of ANGOF-based IRT method and Bookmark method for standard Setting of MSRT language test
پديد آورندگان :
جلالي زاده، محمدآزاد دانشگاه علامه طباطبايي، سنندج , دلاور، علي دانشگاه علامه طباطبايي، تهران , فرخي، نورعلي دانشگاه علامه طباطبايي - گروه سنجش و اندازه گيري، تهران , عسگري، محمد دانشگاه علامه طباطبايي - گروه سنجش و اندازه گيري، تهران
تعداد صفحه :
21
از صفحه :
49
تا صفحه :
69
كليدواژه :
آزمون زبان MSRT , نمره برش , بوكمارك , آنگوف مبتني بر نظريه سوال - پاسخ
چكيده فارسي :
هدف اصلي اين پژوهش مقايسه روش آنگوف مبتني بر IRT و روش بوكمارك در تعيين استاندارد چيرگي آزمون زبان MSRT بود. بدين منظور، يكي از نمونه سوالات آزمون MSRT (آزمون مورخه شهريور 1397) به طور تصادفي انتخاب شد و پاسخ هاي داده شده به سوالات توسط 596 آزمودني از وزارت علوم اخذ شد. آزمون MSRT داراي 100 سوال بوده كه 30 سوال آن را گرامر، 30 سوال بخش شنيداري و 40 سوال آن را بخش درك مطلب خواندن تشكيل مي دهد. دو پنل تخصصي متشكل از 15 متخصص تدريس آزمون تافل تشكيل شد و سپس با استفاده از روش هاي تعيين استاندارد آنگوف مبتني بر نظريه سوال- پاسخ، و بوكمارك استانداردهاي اين آزمون در سه بخش جداگانه (گرامر، شنيداري، درك مطلب خواندن) در سه مرحله ارزيابي مشخص شدند. يافته هاي تحقيق گوياي اين بود نمره برش بدست آمده از روش آنگوف مبتني بر نظريه سوال پاسخ برابر با 53/66 و روش بوكمارك برابر با 54/27 است. هر دو نمره برش بدست آمده از نمره تعيين شده توسط وزارت علوم بالاتر بود. همچنين، يافته هاي تحقيق نشان دادكه در روش معمول و سنتي وزارت علوم كه بر پايه نمره 50 به عنوان نمره قبولي عمل مي شود 73/3 درصد از شركت كنندگان مردود و 26/7 درصد از شركت كنندگان قبول شده اند اما، اساس روش آنگوف مبتني بر نظريه سوال- پاسخ آمار مردودي برابر 78/5 درصد و آمار قبولي برابر با 23/4 درصد مي شود. در نهايت براساس بوكمارك آمار مردودي برابر با 21/5 درصد مي شود. يافته هاي تحقيق دلالت بر اين دارند كه طراحان آزمون زبان وزارت علوم نياز به بازنگري در تعيين نمره استاندارد اين آزمون دارند.
چكيده لاتين :
The main purpose of this study was to compare the Angof-based IRT method and the Bookmark method determine standardization of the MSRT language test. For this purpose, one sample of the MSRT test questions (September 1397 test) was randomly selected and the answers to the questions were obtained by 596 subjects from the Ministry of Science. The MSRT test has 100 questions, of which 30 are grammar, 30 are auditory, and 40 are reading comprehension. Two expert panels consisting of 15 TOEFL teaching experts were formed and then standardized using ANGOF-based IRT method, and Bookmark's standards in three separate sections (grammar, listening, Reading comprehension) were identified in three evaluation stages. The findings of the study showed that the cut-off score obtained by Angof's method based on the question-answer theory is 53.66 and the bookmark method is 54.27. Both cut scores were higher than those determined by the Ministry of Science. Also, the findings of the study showed that 73.3% of the participants rejected the traditional and traditional method of the Ministry of Science, which is based on the score of 50, but 26.7% of the participants failed but based on the Angof method. Based on the question-answer theory, rejection rates are 78.5% and acceptance rates are 23.4%. Finally, according to Bookmark, the decline in statistics is 21.5%. The research findings imply that Ministry of Science language test designers need to be revised to determine the standard score of this test. The main purpose of this study was to compare the Angof-based IRT method and the Bookmark method to determine standardization of the MSRT language test. For this purpose, one sample of the MSRT test questions (September 1397 test) was randomly selected and the answers to the questions were obtained by 596 subjects from the Ministry of Science. The MSRT test has 100 questions, of which 30 are grammar, 30 are auditory, and 40 are reading comprehension. Two expert panels consisting of 15 TOEFL teaching experts were formed and then standardized using ANGOF-based IRT method, and Bookmark's standards in three separate sections (grammar, listening, Reading comprehension) were identified in three evaluation stages. The findings of the study showed that the cut-off score obtained by Angof's method based on the question-answer theory is 53.66 and the bookmark method is 54.27. Both cut scores were higher than those determined by the Ministry of Science. Also, the findings of the study showed that 73.3% of the participants rejected the traditional and traditional method of the Ministry of Science, which is based on the score of 50, but 26.7% of the participants failed but based on the Angof method. Based on the question-answer theory, rejection rates are 78.5% and acceptance rates are 23.4%. Finally, according to Bookmark, the decline in statistics is 21.5%. The research findings imply that Ministry of Science language test designers need to be revised to determine the standard score of this test. The main purpose of this study was to compare the Angof-based IRT method and the Bookmark method to determine standardization of the MSRT language test. For this purpose, one sample of the MSRT test questions (September 1397 test) was randomly selected and the answers to the questions were obtained by 596 subjects from the Ministry of Science. The MSRT test has 100 questions, of which 30 are grammar, 30 are auditory, and 40 are reading comprehension. Two expert panels consisting of 15 TOEFL teaching experts were formed and then standardized using ANGOF-based IRT method, and Bookmark's standards in three separate sections (grammar, listening, Reading comprehension) were identified in three evaluation stages. The findings of the study showed that the cut-off score obtained by Angof's method based on the question-answer theory is 53.66 and the bookmark method is 54.27. Both cut scores were higher than those determined by the Ministry of Science. Also, the findings of the study showed that 73.3% of the participants rejected the traditional and traditional method of the Ministry of Science, which is based on the score of 50, but 26.7% of the participants failed but based on the Angof method. Based on the question-answer theory, rejection rates are 78.5% and acceptance rates are 23.4%. Finally, according to Bookmark, the decline in statistics is 21.5%. The research findings imply that Ministry of Science language test designers need to be revised toThe main purpose of this study was to compare the Angof-based IRT method and the Bookmark method to determine standardization of the MSRT language test. For this purpose, one sample of the MSRT test questions (September 1397 test) was randomly selected and the answers to the questions were obtained by 596 subjects from the Ministry of Science. The MSRT test has 100 questions, of which 30 are grammar, 30 are auditory, and 40 are reading comprehension. Two expert panels consisting of 15 TOEFL teaching experts were formed and then standardized using ANGOF-based IRT method, and Bookmark's standards in three separate sections (grammar, listening, Reading comprehension) were identified in three evaluation stages. The findings of the study showed that the cut-off score obtained by Angof's method based on the question-answer theory is 53.66 and the bookmark method is 54.27. Both cut scores were higher than those determined by the Ministry of Science. Also, the findings of the study showed that 73.3% of the participants rejected the traditional and traditional method of the Ministry of Science, which is based on the score of 50, but 26.7% of the participants failed but based on the Angof method. Based on the question-answer theory, rejection rates are 78.5% and acceptance rates are 23.4%. Finally, according to Bookmark, the decline in statistics is 21.5%. The research findings imply that Ministry of Science language test designers need to be revised to determine the standard score of this test. determine the standard score of this test. The main purpose of this study was to compare the Angof-based IRT method and the Bookmark method to determine standardization of the MSRT language test. For this purpose, one sampl of the MSRT test questions (September 1397 test) was randomly selected and the answers to the questions were obtained by 596 subjects from the Ministry of Science. The MSRT test has 100 questions, of which 30 are grammar, 30 are auditory, and 40 are reading comprehension. Two expert panels consisting of 15 TOEFL teaching experts were formed and then standardized using ANGOF-based IRT method, and Bookmark's standards in three separate sections (grammar, listening, Reading comprehension) were identified in three evaluation stages. The findings of the study showed that the cut-off score obtained by Angof's method based on the question-answer theory is 53.66 and the bookmark method is 54.27
سال انتشار :
1398
عنوان نشريه :
تدريس پژوهي
فايل PDF :
7826202
لينک به اين مدرک :
بازگشت