Evaluating ZipGrade for automated multiple-choice scoring: a pilot study at a Vietnamese medical university
Abstract
The study was conducted to determine the validity and reliability of ZipGrade software in marking multiple-choice exams and compare it with conventional manual marking methods. Implementation time is from October 2023 to January 2024 at Pham Ngoc Thach University of Medicine. Validity is determined by the proportion of tests scored with ZipGrade software whose results completely match the standard results out of the total number of tests, and reliability is determined by the intraclass correlation coefficient (ICC) between two scores of each method and between each method and the standard result. After performing multiple-choice testing on 180 tests, research shows that ZipGrade software has high accuracy (93 to 100%) and high reliability (ICC coefficient from 0.982 to 0.999). Compared with the manual method, ZipGrade software also has statistically significantly higher accuracy and reliability (p < 0.001). The average time to grade a multiple-choice test using the manual method is 6 to 7.7 times that of ZipGrade software. Schools should use ZipGrade software to grade multiple-choice exams and organize training sessions to guide teachers on using it.
Keywords: Multiple-choice question, Reliability, Scoring validity, ZipGrade
How to cite this article:
Citation Formats:
Contact Meral
Meral Publications
www.meralpublisher.com
Davutpasa / Zeytinburnu 34087
Istanbul
Turkey
Email: [email protected]