Nielsen Norman Group Logo  
NN/g    useit.com    jnd.org    AskTog
Nielsen Norman Group
View shopping cart for report downloads at eSellerate
Strategies to enhance the user experience  
Home People Services Publications Events About NN/g
NN/g Home > Publications > Newsletter usability
                        

Nielsen Norman Group Report:

Email Newsletter Usability:
199 Design Guidelines for Newsletter Subscription, Content, and Account Maintenance Based on Usability Studies

4th Edition
   
Download Report (PDF file, 586 pages) 586 pages PDF format
Download Report (from eSellerate)

$497 for the report with a single-user license,
$948 for the report and a site license to make copies within your organization.
(No shipping/handling fees will be added: it's a download.)


Summary

 

Users have highly emotional reactions to newsletters. This is in strong contrast to studies of website usability, where users are usually much more oriented towards functionality. Even a website that you visit daily will feel like a tool where you simply want to get in and get out.

The positive emotional aspect of newsletters is that they can create much more of a bond between user and company than a website can. The negative aspect is that usability problems have much stronger impact on the customer relationship than they normally do.

Users spend 51 seconds reading the average newsletter. The layout and writing both need superb usability to survive in the high-pressure environment of a crowded inbox.

Averaged across our study, newsletters lost 19% of potential subscribers due to usability difficulties in their subscription processes and designs. People often stay subscribed to newsletters they don't want (cursing the sender with every new issue that clutters their inbox), so the unsubscribe process is also worth improving.

Newsletters need to be smooth and easy: they must be seen to reduce the burdens of modern life. Even if free, the cost in e-mail clutter must be paid for by being helpful and relevant to users - and by communicating these benefits in a few characters in the subject line.

This report shows what happened when real people used a broad set of real newsletters: trying to get on and off the subscription lists, maintaining their subscriptions, and receiving issues in their inboxes (sometimes opening the newsletters and sometimes scanning or reading them).

> executive summary of the report
> sample chapter as thumbnail pages

The 199 design guidelines in the report are based on usability tests of 270 email newsletters. User testing was mainly conducted in the United States (in 12 states across the country) but we also studied users in Australia, Hong Kong, Japan, Sweden, and the United Kingdom. Most newsletters were studied in the users' own environment, focusing on the user experience of receiving and reading newsletters. These newsletters were about equally divided between business newsletters and personal newsletters.

The following 45 newsletters were tested exhaustively in the usability lab:

  • AdAge.com: AdAge Daily (daily B2B industry news)
  • Allrecipes.com: Daily Dish (cooking advice)
  • Bankrate.com: Frugal News (financial information)
  • BBC Weather (news/weather)
  • BNET: Business Tools for Busy Leaders (weekly management info)
  • Bob's Stores (B2C e-commerce — sporting goods)
  • Carnival Cruise Lines (travel/cruise line)
  • Cooking.com: All About Shopping (retail)
  • DailyPuppy: The Daily Puppy (Daily feel-good, featuring a "puppy of the day")
  • Dale Carnegie (B2B — training courses)
  • Dictionary.com: Word of the Day (reference)
  • The Economist: The World This Week (weekly news)
  • EHS Today: Weekly Update (B2B — environmental health and safety)
  • eMusician: eMusician XTRA (B2B magazine — products for performing artists)
  • Entertainment Weekly: EW Monitor (daily specialized news)
  • Fodors.com (weekly travel advice)
  • Foundation Center: Philanthropy News Digest (non-profit)
  • Funniest Stuff: Today's funny stuff (jokes)
  • Funny or Die: Weekly F'Bomb (jokes)
  • Handspring (consumer electronics customer newsletter)
  • The Herman Group: Trend Alert (weekly B2B consulting insights)
  • The Independent: IndyNews (U.K. national newspaper)
  • Kraft: food&family CPG consumer products — food and beverages)
  • Lonely Planet: Best of Lonely Planet (travel)
  • ManhattanUsersGuide.com (daily local entertainment guide)
  • Morningstar: Technology Bytes (twice-weekly investment advice)
  • MSNBC: Breaking News Email (daily news)
  • New York City Parks and Recreation: The Daily Plant (update from municipal department)
  • New York Times: Books Update (weekly book reviews)
  • Ode Magazine: And now for the good news... (news)
  • Overstock.com: O-Mail (e-commerce)
  • Reuters (news)
  • Site 59: Top Picks (travel deals)
  • SmarterTravel.com: Last Minute Airfares (travel deals)
  • Susan G. Komen for the Cure: KomenLink (non-profit / health)
  • Thrillist: Thrillist Boston (local news)
  • Tide: Tide Current (CPG consumer product — laundry detergent)
  • Toyota: Your Toyota eNews (cars)
  • ToysRUs: Safety and Recall Notices (B2C e-commerce — toys)
  • USAToday.com: Daily Briefing (news headlines)
  • Virgin: Fare Alerts (B2C e-commerce — air travel)
  • WineLoversPage.com: The 30 Second Wine Advisor (weekly wine tips)
  • Yahoo! Sports (news/sports)
  • Zacks.com: Profit from the Pros (investment advice)
  • Zappos (B2C e-commerce — shoes)

The remaining newsletters were tested with a few users each. This is particularly true for the B2B newsletters which were often so specialized that only a few study participants received any given newsletter.

The report is richly illustrated with 487 color screenshots of newsletters and subscribe/unsubscribe screens that worked well or caused problems in user testing, including eyetracking heatmaps showing where users looked when reading newsletters. The screenshots show examples and best practices from hundreds of different newsletters and websites.


Comparing the Editions

 

If you already own the first or second edition of this report, should you buy the fourth edition? Probably yes, because the combined number of new findings in the third and fourth edition is substantial.

If you own the third edition, we only recommend buying the fourth edition if e-mail newsletters are your main job focus or if you target mobile users. For people who are less heavily engaged in e-newsletters, there is no reason to spend time and money on the fourth edition if you have the third edition. The most important guidelines were included in the third edition and none of the findings in the third edition were invalidated in the fourth study.

Comparison of the editions:

1st edition 2nd edition 3rd edition 4th edition
Guidelines 79 127 149 199
Page count 186 293 494 586
Screenshots 109 165 342 487
Report file size 5 MB 9 MB 24 MB 30 MB
Newsletters tested 10 111 228 270
Methods Lab testing Diaries Eyetracking,
field studies
Lab testing
Emphasis B2C B2C and B2B B2C and B2B B2C and B2B
Devices Desktop Desktop Desktop Desktop,
mobile

Table of Contents

 

586-page report

  1. Executive Summary
    • User Research
    • High Nominal Usability
    • Increasing Newsletter Usability
    • Low Perceived Usability
    • Speed Matters
    • Mobile Use: Quick Reads, Slow Reads
    • Significant Platform Diversity
    • Spam Is a Fact of Life
    • The Battle for the Inbox
    • Scannability and Immediate Utility
    • Competing With Social Networks
    • RSS/News Feeds
    • Video in Email
    • Long Live the Internet (and Your Newsletter)
    • Future of Email Newsletters
  2. Overview of the Usability Studies
    • First Study
    • Second Study
    • Third Study
    • Fourth Study
  3. About This Report (Fourth edition)
  4. Email and Newsletters
    • People are Overwhelmed with Information
    • Managing Email
    • Dealing with Newsletters
    • Saving Email Newsletters
    • Immediate and Constant Email Access
    • Users Are Fighting Spam
  5. Information Sources Compete for Users' Attention
  6. The Pros and Cons of Newsletters
    • Benefits of Email Newsletters
    • The Downside of Email Newsletters
  7. Most Valuable and Least Valuable Newsletters
    • Most Valuable Newsletters
    • Least Valuable Newsletters
  8. Business Newsletters
    • Business Relationships
    • Making or Influencing Business Purchase Decisions
    • Personalization in Business Newsletters
  9. Using Newsletters
    • Signing Up for Newsletters
    • Selecting Messages From the Inbox
    • Skimming is Reading
    • What Users Read
    • Forwarding and Sharing Newsletters
  10. Interpreting the Study Data
    • Amount of Email and Spam
    • Time to Read Newsletters
    • Time to Subscribe and Unsubscribe
    • Success Rates
  11. Design Guidelines
  12. Subscription
    • Link Name and Placement
    • Subscription Process
    • Confirming Subscriptions
    • Respecting Subscribers
  13. Frequency and Delivery
  14. Sender and Subject Line
    • Sender
    • Subject Line
  15. Content and Writing
    • Newsletter Content
    • Information Prioritization
    • Information Presentation
    • Links
    • Voice and Tone
    • Personalization
  16. Layout and Visual Design
  17. Encouraging New Subscriptions
  18. Subscription Maintenance and Unsubscribing
    • Maintanence Options and Unsubscribe Links
    • Unsubscribe Process
  19. How to Avoid Being Mistaken for Junk Mail
  20. Sites with Good Design Examples
  21. Screenshots of Users' Highly Rated Newsletters: Second, Third, and Fourth Studies
  22. About the Sites and Newsletters Studied
  23. About Participants
  24. Methodology: First Study
    • About Using This Methodology: First Study
  25. Methodology: Second Study
    • About Using This Methodology: Second Study
  26. Methodology: Third Study
    • About Using This Methodology: Third Study
  27. Methodology: Fourth Study
    • About Using This Methodology: Fourth Study

What You Get

 
  • Checklist of 199 specific design recommendations: review your subscription interface and your newsletter designs for these 199 best practices, and you will discover several things that need improvement.
    • The average newsletter violates about 1/3 to 1/2 of the usability guidelines enumerated in this report. You might have the one perfect site in the world that does everything right, but the odds are against you. It is safest to score your designs against a checklist of usability guidelines to make sure you don't do anything wrong.
    • Checklists save lives in the operating room and airplane cockpit, even when surgeons and pilots are already superbly trained. A newsletter design checklist may not save lives, but it'll save you many times the purchase price.
  • Description of how real people behave when subscribing, receiving email, and reading email, including extensive quotes (often colorful, because they were often annoyed). Learn from the users' comments and reactions to common design mistakes in the newsletters we tested.
  • 487 screenshots of email newsletters and subscriptions screens with descriptions of why they worked well for users or caused them problems in usability testing.
  • $400,000 of user research at 0.1% of the cost.
  • Study methodology details, allowing you to run your own user tests of your own newsletters. This includes test tasks, questionnaires, and other study protocols that have been refined through our many rounds of research.
  • Knowledge to make your newsletter cut through customers' information overload; thus getting read more often. Avoid the negative reputation that follows from a newsletter that annoys users and feels like clutter instead of customer service.

Who Should Read This Report?

 
  • Anybody who is responsible for the design, implementation, or strategy for email newsletters.
  • Web designers responsible for putting "subscribe" and "unsubscribe" features on a website.
  • Newsletter editors.
  • Internet marketing managers.

Running a similar series of usability studies yourself to collect comparative design lessons from hundreds of newsletters in multiple countries would cost about $400,000.

Please help us continue publishing low-price reports by buying a site license if you have colleagues who will read the report. If you only need it for yourself, then that's obviously what the single-user license is for. If somebody "gives" you a copy, then please buy a download anyway to keep prices down in the future.

Download Report (PDF file, 586 pages) Download Report (from eSellerate)
$497 for the PDF file (586 pages)
$948 for site license that allows you make multiple copies and distribute within your organization

                     
  

Press Coverage

Wall Street Journal:
For Web-Design Expert, Ease of Use And Clarity Are Essential for Firms

ZDNet:
A guide to email newsletters and RSS usability

MediaPost:
Just An Online Minute

Sydney Morning Herald:
The key to email: a two-second grab
"Over the past decade no one else has been so accurate in predicting trends in the evolution of internet media. And Nielsen Norman's published studies are models of clarity."

Seattle Times:
Timely, focused online newsletter a valuable relationship builder

ClickZ
E-Newsletter Readers Grow Itchy Trigger Fingers

DMnews
Consumers Better at IDing Newsletters From Spam

PaidContent
E-mail Newsletter Readers Adapt Behavior to Read Them Through The Flood of Spam

San Francisco Business Times
Spam is reshaping your life

BBC
E-mail makes surfers emotional

Editor & Publisher
Consumers like e-mail newsletters

DMnews
Expert: Web Designs Better But Could Be Better

First Monday
Review (scroll to bottom of page)

EContent
Publish or Perish: Enewsletters Push Business Communication Forward

Buenafuente
Todos los secretos para armar un boletín exitoso en la red (Spanish)

Electronic Commerce Info Net
eMail-Marketing - Kommen Sie durch? (German)
 

See also: Related Report
Usability of Confirmation Email and Transactional Messages
Order confirmation, shipment notification, available-now notices, and other automated customer service

Frequently Asked Question: Alternative Payments
If you do not want to buy online, we accept other forms of payment:
  • Check
  • Bank transfer
  • Purchase orders
  • Faxed or mailed credit cards

We can also send you a paper invoice if your company requires that.

Note Download Time
The PDF document is a big file because of the many illustrations (24 MB). Downloads will take about 2 minutes on a broadband connection.

Frequently Asked Question: File Format Used
The report is a standard PDF file, formatted to print on both 8.5x11 and A4 paper. Any recent version of the Acrobat Reader will suffice to read or print the file. No special software is needed. The file is not copy-protected: we trust you to buy a site license if you are going to have several people read the report.

See also Tutorial
Full-day training course on the usability of email newsletters at the annual Usability Week conference.

NN/g Contact Information

Copyright © 1998-2011 Nielsen Norman Group.  All Rights Reserved