Quizzes and Exams

Online Quiz Formats: Do They Matter?

Use of online quizzing continues to grow. If taken online, quizzes don’t consume valuable class time. Grading occurs automatically and doesn’t consume valuable teacher time. Students get feedback immediately. The technology also offers a variety of format options. But do we know anything about how

Read More »

Grades: Either Good or Bad

What’s a “good” grade as far as students are concerned? What’s a “bad” grade? Are some grades “neutral” and cause neither disappointment nor pride? Where’s the cutoff for good grades and the starting point for bad ones? In the study referenced below, researchers solicited data

Read More »

Cumulative Finals: There’s Good Reasons to Give Them

Finals that cover all the material presented in the course are decidedly unpopular with students. They much prefer exams that include one chunk of content at a time. But there are good reasons to make finals comprehensive. Consider these results from a recent study of

Read More »

Preparing for Comprehensive Finals

Students don’t like comprehensive exams because most of them don’t use good cross-course study strategies. They wait until finals week and then they start reviewing. Here are some ways teachers can help students develop and use study strategies that make preparing for and doing well on

Read More »

A Grade Forecasting Strategy

I give my second-year undergraduate students the opportunity to forecast their final course grades while the course is still under way. The goal of this predictive or prognostic feedback is to help the students develop a more realistic assessment of their progress in the course

Read More »

Test-Item Order: Does It Matter? A Response

Because research into the effects of test-item order on exam performance has produced equivocal results, the editor recently suggested that “it is not a bad idea for instructors to systematically order test items and analyze the results to see how test-item order might be affecting

Read More »

A New Way to Assess Student Learning

I’m “reflecting” a lot these days. My tenure review is a few months away, and it’s time for me to prove (in one fell swoop) that my students are learning. The complexity of this testimonial overwhelms me because in the context of the classroom experience,

Read More »

Cumulative Exams

Students don’t like them—that almost goes without saying. They prefer unit exams that include only material covered since the previous exam. And they’d like it even better if the final wasn’t a comprehensive exam but one last unit test. But students don’t always prefer what

Read More »

Test-Item Order: Does It Matter?

Frequently instructors discourage cheating on multiple-choice exams by creating different versions of the exam. Test questions may be reordered randomly, according to their degree of difficulty, or in the order the material was presented in class, or the answer options may be ordered differently. The

Read More »
Archives

Get the Latest Updates

Subscribe To Our Weekly Newsletter

Magna Digital Library
wpChatIcon

Use of online quizzing continues to grow. If taken online, quizzes don't consume valuable class time. Grading occurs automatically and doesn't consume valuable teacher time. Students get feedback immediately. The technology also offers a variety of format options. But do we know anything about how these various quiz formats affect learning? We don't know much and so far the research offers an array of mixed results. But a recent study finds that format does make a difference.

Students in this study (a sizable cohort) were enrolled in one or two semesters of an introductory undergraduate physiology course at the University of New South Wales. Starting in 2009 a quizzing component was introduced in the course, and during the next three years it was used in the four different formats described below.

  1. Three quizzes, each worth 5 percent of the grade, taken without supervision, with the use of notes and textbook discouraged, each 10 questions and each completed in 20 minutes with only one try
  2. Three quizzes, each worth 5 percent of the grade, taken with supervision, no books or notes permitted, each with 10 questions and each completed in 20 minutes with only one try
  3. Two quizzes, each worth 7.5 percent of the grade, taken with supervision, no books or notes, each with 15 questions and each completed in 30 minutes with only one try
  4. Five quizzes, each worth 2 percent of the grade if the score was higher than 90 percent, taken without supervision, open book, with more questions, no time limit and unlimited tries

“Cohorts of students undertaking the courses in which quizzes were offered in the format of models 1-3 did not demonstrate any significant overall improvement in learning outcomes as measured by performance in the summative end-of-session examinations. In contrast, the implementation of quizzes in the format of model 4 ... was associated with a significant improvement in mean summative end-of-session examination scores.” (p. 196) The research team offers this larger conclusion at the end of the article: “Our study supports the notion that in order for online formative assessments to be effective, they must be perceived by students to be relatively low stakes and allow exploration of existing and expected knowledge in a nonthreatening environment.” (p. 199)

There was also a strong correlation between quiz scores obtained in all four formats and scores on the final exam. Students who did well on the quizzes did well on the final, and students who did poorly on the quizzes did poorly on the final exam, often failing it. On the basis of this correlation, the researchers suggest that teachers could use quiz scores to identify those students needing extra help and seek to intervene with them while there is still time for those students to make changes that could improve their overall performance in the course.

Students in these two sequenced courses appreciated the use of quizzes. Sizable majorities said the quizzes guided their study for the exams, helped them learn the content, provided feedback on their learning, and were challenging and valuable overall. A student who took the quizzes in format 4 wrote in response to an open-ended question, “Excellent revision tool. I would read over the lectures first, then attempt them first time under exam conditions—then redo them with material.” (p. 195)

Reference: Marden, N.Y., Ulman, L.G., Wilson, F.S., and Velan, G.M. (2013). Online feedback assessment in physiology: Effects on students' learning experiences and outcomes. Advances in Physiology Education, 37 (2), 192-200.