Witchel, Harry J, Guppy, Joseph H and Smith, Claire F (2018) The self-assessment dilemma: an open-source, ethical method using Matlab to formulate multiple-choice quiz questions for online reinforcement. Advances in Physiology Education, 42 (4). pp. 697-703. ISSN 1043-4046

PDF - Accepted Version Download (2MB)

Abstract

Student self-assessment using computer-based quizzes has been shown to increase subject memory and engagement. Some types of self-assessment quizzes can be associated with a dilemma between 1) medical students who want the self-assessment quiz to be clearly related to upcoming summative assessments or curated by the exam-setters, and 2) university administrators and ethics committees who want clear guarantees that the self-assessment quizzes are not based on the summative assessments or made by instructors familiar with the exam bank of items. An algorithm in Matlab was developed to formulate multiple-choice questions for both ion transport proteins and pharmacology. A resulting question/item subset was uploaded to the Synap online self-quiz web platform, and 48 year 1 medical students engaged with it for 3 wk. Anonymized engagement statistics for students were provided by the Synap platform, and a paper-based exit questionnaire with an 80% response rate (n=44) measured satisfaction. Four times as many students accessed the quiz system via laptop compared with phone/tablet. Of 391 questions/items, over 11,749 attempts were made. Greater than 80% of respondents agreed with each of the positive statements (ease of use, enjoyed, engaged more, learned more, and wanted it to be extended to other modules). Despite simplistic questions and rote memorization, the questions developed by this system were engaged with and were received positively. Students strongly supported extending the system.

Item Type:	Article
Keywords:	formative assessment; item construction; Matlab; online assessment; self-regulated learning
Schools and Departments:	Brighton and Sussex Medical School > Division of Medical Education Brighton and Sussex Medical School > Neuroscience
Depositing User:	Alexei Fisk
Date Deposited:	26 Nov 2018 14:06
Last Modified:	28 Apr 2023 11:24
URI:	http://sro.sussex.ac.uk/id/eprint/80399

View download statistics for this item

📧 Request an update