Multiple-choice questions get a bad rap, and it is easy to see why. Most do not assess higher-order thinking—you either know the answer or you don’t. And if you do know the correct choice, it does not reveal depth of knowledge. So how can we
A couple of months ago we posted a series of questions about teacher questions—the ones they ask students—and asked for your answers. Here’s a compilation of those responses with a few of my comments sprinkled throughout.
I continue to be concerned that we don’t design learning experiences as developmentally as we should. What happens to students across a course (and the collection of courses that make up a degree program) ought to advance their knowledge and skills. Generally, we do a
Students ask all different kinds of questions. Some are on the money—good, honest queries about content that they don’t understand or want to know more about. Other student questions are more difficult to handle. It’s good to have some strategies lined up for when these
I don’t know a single teacher who doesn’t try to use questions to encourage student interaction. The problem is that most of us don’t spend a whole of time thinking about the kinds of questions we’re asking students, how or why we’re doing it, and
Preparing one of the plenary sessions for the recent Teaching Professor Conference provided me the opportunity to do some more work on questions, which if you’re a regular reader of this blog you will recognize as an ongoing interest of mine for more than a
Good answers depend on good questions. That’s why we work so hard on the content of our questions and why we should work with students on how they ask their questions. What also helps to make questions good is asking the right type of question.
Magna Publications © 2023 All rights reserved
Multiple-choice questions get a bad rap, and it is easy to see why. Most do not assess higher-order thinking—you either know the answer or you don’t. And if you do know the correct choice, it does not reveal depth of knowledge. So how can we construct them to better assess learning?
Let’s consider two version of a question taken from a large survey course I teach to undergraduate nonmajors about the biological bases of behavior. Both are meant to assess how well students can identify scientific tools for studying different research questions.
Which of these provides the best spatial resolution?
A. fMRI (functional magnetic resonance imaging)
B. PET (positron emissions tomography)
C. CAT (computer axial tomography)
D. EEG (electroencephalogram)
The correct answer is (A) fMRI. How is this knowledge valuable? The question does not assess that. Here is another version, with the same correct answer and choices.
Dr. Pons investigates how the brain perceives human faces. In an upcoming experiment, she wants to find out whether seeing a male face compared to a female face is (1) faster and (2) done by a different part of the brain. To answer these questions, which of the following tools would BEST answer Dr. Pons’ research questions?
This version of the question requires a student to evaluate the different tools to answer it correctly. Here are six guidelines that have helped me make the most of my multiple-choice questions.
Do not waste time and space with implausible options. For example, “flashlight” would be implausible, and any question that it brings about is likely off topic.
All the choices listed are plausible. Our readings reviewed notable experiments using each one. This deliberation period is a chance to review them again. And the incorrect options are definitely incorrect. EEG is not used to study regional differences, CAT does not measure function, and PET does not monitor speed well.
To answer her questions, Dr. Pons needs a tool that can report on both activation speed and regional differences. Only option (A) fMRI can do both, making this the one clear correct answer. Avoid “Select all that apply” or options such as “A and B” or “A and C.” Make only one answer correct.
In my example, I want to know whether students understand how the tools are different. If they are unsure of any one of them, this exercise would identify questions about those specific tools. Suppose “E. All of the above” were a choice and was a student’s selection. Because it is incorrect, I would know that they needed help. But what? I would be back to helping them identify their questions.
What if “All of the above” were the correct answer? Here is a version of the question for which that is true:
Dr. Pons investigates how the brain perceives human faces. Which of the following are tools she can use for her research?
This “All of the above” correct answer fails to assess whether students can identify tools appropriate for different research questions. A student may be able to, but their correct answer masks their level of knowledge. The same applies to the next guideline.
If “None of the above” were the correct answer to a question? Here is a version of the question for which that is true:
Dr. Pons investigates how the brain perceives human faces. Which of the following cannot be used for her research?
Any uncertainty or understanding of each tool would not be evident. Suppose a student correctly chose “None of the above.” As in Guideline 3, their level of knowledge is masked.
Test-wise students will pick the longest option if they are unsure of the answer—the logic being that it is “too long to be wrong.” Imagine that in our example, the choices were as follows:
A. 7-Telsa functional magnetic resonance imaging
B. PET
C. CAT
D. EEG
The greater detail could sway a student to think it has more merit if they were uncertain about the other options. Following this logic, I would also avoid having one oddly short option.
If this is not feasible, make two options of similarly odd lengths: two short or two long. We want a student to choose or avoid an oddity, whether correct or incorrect, because of its content.
Students who have a question might not share it in class lest they come across “dumb.” But in small groups, minus the teacher, they may be less intimidated. Maybe another student will answer their question. If not, this means other students also do not know the answer or share the same question. Now it has become a good question to ask the teacher together.
The small group can also help the student who is perplexed but does not yet have the words to pinpoint their confusion. Here, there is an opportunity for discussion and exchange of ideas. These conversations can help students identify the words to formulate their question.
While each student can enhance one another’s learning, they can also dwell on the implausible. The multiple-choice question format provides structure that focuses the discussion and saves time. It ensures your students efficiently discuss specific items you determined are most valuable.
Sibley, J., & Ostafichuk, P., with Roberson, B., Franchini, B., & Kubitz, K. (2014). Readiness assurance process: Writing good multiple-choice questions. In Getting started with team-based learning (pp. 91–97). Stylus.
Minna Ng, PhD, is assistant professor of the practice of psychology and neuroscience at Duke University.
