Jon Tarrant, Creator of physbang.com and former Head of Sciences (retired), UK Multiple-choice questions (MCQs) are carefully designed to identify key knowledge but they generally rely on either rewarding correct answers or penalising wrong answers (Lesage et al., 2013). There is normally no record of students who hesitated between the correct answer and a well-designed distractor. Hearing students comment ‘I was going to put that but I changed my mind’ reveals valuable information that the assessment has missed, as does the admission ‘I got that right and it was just a guess’. This case study follows the development of a way in which to capture confidence information and looks at how it can be used to provide targeted feedback. The potential benefits of encouraging students to indicate how confident they are in their answers have previously been summarised (Curtis et al., 2013) and reviewed in detail (Novacek, 2017). The greatest benefit resides in being able to provide be
Assessing and responding to student confidence in MCQ tests
Written by: Jon Tarrant
6 min read
- Chu HE, Chandrasegaran AL and Treagust DF (2018) Two-tier multiple-choice questions for heat and temperature concepts. School Science Review 99(368): 107–116.
- Curtis DA , Lind SL, Boscardin CK et al. (2013) Does student confidence on multiple-choice question assessments provide useful information? Medical Education 47(6): 578–584.
- Gardner-Medwin AR (1995) Confidence assessment in the teaching of basic science. ALT-J Research in Learning Technology 3(1): 80–85.
- Lesage E, Valcke M and Sabbe E (2013) Scoring methods for multiple choice assessment in higher education – is it still a matter of number right scoring or negative marking? Studies in Educational Evaluation 39(3): 188–193.
- Novacek PF (2017) Exploration of a confidence-based assessment tool within an aviation training program. Journal of Aviation/Aerospace Education & Research 26(1). DOI: 10.15394/jaaer.2017.1717.
- Sparck EM, Bjork EL and Bjork RA (2016) On the learning benefits of confidence-weighted testing. Cognitive Research: Principles and Implications 1(3). DOI: 10.1186/s41235-016-0003-x.
- Tabibzadeh N, Mullaert J, Zafrani L et al. (2020) Knowledge self-monitoring, efficiency, and determinants of self-confidence statement in multiple choice questions in medical students. BMC Medical Education 20(1): 445.
- Tarrant J (2022) Energy Revision – new resource. In Mr Tarrant’s Physbang ‘blog. Available at: https://physbang.wordpress.com/2022/05/06/energy-revision-new-resource (accessed May 2022).