Test-Taking Enhances Learning

by Jakob Nielsen on January 31, 2011

Summary: People remember much more after reading if they retrieve information about the text from memory. Quizzes are one way websites can help users remember more.

I have long worried that the Web is unsuited for real learning. The basic problem is users' superficial "surfing" of information: as countless studies have shown since 1997, people tend to scan text on websites instead of reading it closely.

Given this, we must acknowledge that users are rushed and don't care much about our websites — they just want to satisfy their current needs and leave as quickly as possible. This leads to classic writing-for-the-Web guidelines such as:

All very fine, but there are cases in which users really do need to learn something rather than get only the highlights. Educational sites obviously fall in this category, whether targeted at teens or college students. But many commercial sites also need to educate users.

Let's say, for example, that you're producing a pharmaceutical site about a drug for patients with high blood pressure. One of your goals is to advise them on what to do in addition to taking their pill, but you can't just say, "eat less sodium." You must teach people what this really means; for example, you might offer strategies for ordering at a Mexican restaurant. People with a strong conceptual model are more likely to successfully reduce their blood pressure and to keep it down over the long run.

145% More Info Retained after Taking Tests

How can we help users learn more from our website content? A recent research study comes to the rescue here.

Jeffrey D. Karpicke and Janell R. Blunt from Purdue University published a paper in Science this month that measured the amount of information people could remember a week after reading a scientific text.

Students who completed an elaborate test after reading the text remembered 145% more content after a week than students who simply read the text and didn't do anything else.

Interestingly, the people who took the test thought that they had learned 15% less than the people who read the text but didn't take the test, even though they'd actually learned much more. This discrepancy between belief and reality adds another twig of evidence to the huge pile of existing studies telling us to observe users' actual behavior and not go by what they say.

In this case, it's obvious (after the fact, of course) why the test-takers thought they'd learned less when they'd actually learned more: taking the test exposed whatever holes they had in their knowledge and thus (correctly) undermined their confidence. In contrast, people who read the text but didn't get tested were smug and predicted that they'd score better than they actually did on the following week's exam.

The test-taking condition was a retrieval practice test, which is much more elaborate than traditional tests. The full procedure was:

  1. Read the text.
  2. Recall as much of the information as you can on a free-recall test.
  3. Read the text again.
  4. Complete another free-recall test.

It's no big surprise that people remember more after this elaborate procedure, which involves working with the information 4 times. However, the researchers also studied a condition where people simply read the text 4 times. These readers also remembered more a week later than people who had read the text a single time, but only 64% more.

In other words, replacing 2 rereads with 2 tests strongly boosted people's week-later performance.

There are two main reasons for this:

  • During step 3 — which was the sole reread for the retrieval practice readers — people would presumably pay more attention to any information that they didn't recall in step 2. In contrast, people who simply kept reading the same stuff repeatedly simply developed a false sense of superiority without awareness of their failings.
  • The recall tests lodged concepts more firmly in memory. It's long been an established finding in psychology that the more you remember something, the better you remember it. The very act of recalling something encodes it stronger in the brain for future use. (Our full-day seminar on The Human Mind and Usability has more on the user interface design implications of human memory and other psych findings.)

Implications for Web Design

If you're a student who wants to pass an exam, you now know how to study: do free-recall tests after reading each chapter of your textbook.

But what does this research mean for practical design projects?

There's no way we can force Web users to endure a full retrieval practice test and write two essays on everything they remember each time they visit one of our pages.

In most cases, users shouldn't even bother with retrieval practice. Going through all 4 steps of the procedure takes about 300% more time than reading information once. And it results in only 145% more information retained.

The cost-benefit analysis definitely favors the superficial approach: you can read 4 articles and retain a bit from each, or you can study a single article thoroughly in the same amount of time. Information foraging theory and empirical observations both tell us the same thing: users prefer broader exposure to deeper learning.

Still, in a few cases, users do want to dive deeper. It's profitable to target these motivated users, just as there is an advantage to writing insightful articles instead of quick-hit blog postings. When you consider user experience as branding, it's obviously beneficial if customers remember more from your site than from the superficial sites.

Although true retrieval practice isn't realistic on the Web, you could make a game of it, encouraging users to write down as much as they remember and then click through to a checklist that lets them count how many concepts they noted correctly. For most sites, however interactive quizzes are probably more feasible: even though it's better for people to write down stuff in a free-recall test, writing feels like work and users prefer simply clicking buttons.

In any case, the point is to get users to exercise their memory after reading your content, and then offer them a chance to revisit the material after they've seen how little they remember.

Now, go and write down what you remember from this article, and then read it again :-)

Share this article: Twitter | LinkedIn | Google+ | Email