Multiple-choice exams are a quick and easy way to assess students’ understanding of a topic. Plus, since it’s a method of retrieval practice, it can also help improve students’ retention and recall performance. But is there such a thing as the perfect multiple-choice test?
There are many factors to consider when it comes to designing a multiple-choice test. For example, how many options should you include? How difficult should the questions be? Should you give feedback?
Researchers have explored this exact question, and have suggested 6 guidelines that you may want to consider when designing a multiple-choice test for your students. This blog summarises their findings…
6 tips to design the best multiple-choice test
In this review, researchers outlined the 6 top practices when creating a multiple-choice test:
1. Avoid complex questions or answer formats
A highly ineffective method of designing multiple-choice questions is having complex questions and answers. If the question is overly complicated, it becomes less about how well students can retrieve the information. The complexity feeds ambiguity.
If the question is too complex, then students aremore likely to guess the answer. This could be tricky, as if they get it right, we do not know if it is because they really know the answer or if they just got lucky.
The same thing happens when students are given complex answering methods, such as answer-until-correct method where if students get the answer wrong on the first attempt, they can continue answering until they find the correct answer. However,research shows no benefitsto using this method over having a traditional multiple-choice with immediate feedback.
2. Create questions with specific cognitive processes in mind
When creating a multiple-choice test, each question included should measure a specific part of knowledge or thought process. For example, multiple-choice questions may be:
- Requiring students to retrieve a fact
- Contrasting two topics
- Apply a theory to a new situation
By targeting specific parts of knowledge or thought processes, it allows us to help build up their schema and therefore, increase their rate of learning.
3. Avoid “none of the above” or “all of the above” options
Generally speaking, it may be prudent to stay away from using these options. Why is this the case? Well, a “none of the above” option exposes students to many false answers.As research shows, this can result in a negative effect on students’ performance, as they continue to falsely select an incorrect answer.
On the other hand, if the “all of the above” option is correct, it can be useful as students are exposed to all the correct answers. However, if this option is not correct it can result in students believing that multiple false alternatives are true. Therefore, both of these options could be detrimental to students’ learning.
4. 3-4 is the magic number
One of the biggest debates when creating a multiple-choice test is how many options to include. Ameta-analysis that included studiesfrom over 80 years found that having three options is the sweet spot. Having one correct answer and two lures creates the best balance between quality and efficiency.
However, this is a rough guide. It also depends on the number of plausible incorrect options that can be made. For example, if there are three suitable incorrect options, having four options might be the way to go.
5. Have moderately difficult tests
Tests should challenge students, but not be too difficult. In the review, researchers suggest that students should correctly answer an average of 77% (which seems to us to a very specific number!), which is slightly higher than the midpoint between what they would get by chance and perfect performance – and reminiscent ofRosenshine’s seventh Principle of Instruction.
Challenging students and having high expectations for them can helpsignificantly improve their academic achievement. This is because students will subsequently raise their effort levels to live up tosomeone else’s high standards. However, if the work is too challenging, it could have a negative impact on their confidence. Therefore, finding the right balance is key.
6. Feedback is your secret weapon
Arguably, the most important aspect when it comes to creating multiple choice tests isgiving feedback. Following a multiple-choice test, students might pick up false information.Research has consistently shownthat giving feedback helps eliminate this misunderstanding and improve students’ performance.
Butwhen should you give feedback? Well,research shows that leaving a short delaybefore giving feedback may be beneficial to learning (though the research on this is somewhat conflicting depending on the exact conditions being measured).
High-impact CPD made easy. Develop evidence-informed CPD at your school, using our exclusive online collection of courses and resources.
Final thoughts
Multiple-choice exams are quick to mark, are generally liked by students and a great way to study. Researchers have put together the six top features in designing a multiple-choice exam. Implementing these can help elevate your multiple-choice exams to the next level.
As always, context is key and there will be times you choose to deviate from the above guidelines. Perhaps the perfect multiple-choice test doesn’t exist, but hopefully these tips can help!
