Analytics & Metrics Articles & Videos

  • Accuracy vs. Insights in Quantitative Usability

    Better to accept a wider margin of error in usability metrics than to spend the entire budget learning too few things with extreme precision.

  • Reduce Bounce Rates: Fight for the Second Click

    Different traffic sources imply different reasons for why visitors might immediately leave your site. Design to keep deep-link followers engaged through additional pageviews.

  • Usability ROI Declining, But Still Strong

    The average business metrics improvement after a usability redesign is now 83%. This is substantially less than 6 years ago, but ROI remains high because usability is still cheap relative to gains.

  • Quantitative Studies: How Many Users to Test?

    When collecting usability metrics, testing with 20 users typically offers a reasonably tight confidence interval.

  • Outliers and Luck in User Performance

    6% of task attempts are extremely slow and constitute outliers in measured user performance. These sad incidents are caused by bad luck that designers can - and should - eradicate.

  • The Slow Tail: Time Lag Between Visiting and Buying

    Users often convert to buyers long after their initial visit to a website. A full 5% of orders occur more than 4 weeks after users click on search engine ads.

  • Putting A/B Testing in Its Place

    Measuring the live impact of design changes on key business metrics is valuable, but often creates a focus on short-term improvements. This near-term view neglects bigger issues that only qualitative studies can find.

  • Risks of Quantitative Studies

    Number fetishism leads usability studies astray by focusing on statistical analyses that are often false, biased, misleading, or overly narrow. Better to emphasize insights and qualitative research.

  • Return on Investment for Usability

    Development projects should spend 10% of their budget on usability. Following a usability redesign, websites increase desired metrics by 135% on average; intranets improve slightly less.

  • Success Rate: The Simplest Usability Metric

    In addition to being expensive, collecting usability metrics interferes with the goal of gathering qualitative insights to drive design decisions. As a compromise, you can measure users' ability to complete tasks. Success rates are easy to understand and represent the UX bottom line.