Analytics & Metrics Articles & Videos

  • Measurement Error in UX Research

    Measurement error is the error we introduce when we measure or observe something about our users. It can come from different sources, such as the number of participants, individual variation between participants, testing environment, or other outside factors. This video helps understand and communicate such measurement errors.

  • Product-Led Growth & UX

    The product-led growth model enables users to try a product or service before paying. This video offers three tips for UX professionals to support a product-led user experience: Connect changes to metrics, interview/survey users, and compare behavior and feedback.

  • Common Errors in Quantitative Research

    False positives and negatives are common errors in quantitative studies that can lead to harmful business decisions. To avoid these mistakes recruit large enough sample sizes, representative participants, and control for confounding variables.

  • Cookie Permissions 101

    Cookie permissions need to follow the law and strike the balance between respecting user privacy and being user-friendly.

  • Personas vs. Analytics Segments

    Avoid creating personas from analytics data alone. Personas are artifacts that aim to capture users' attitudes, goals, and pain points, aspects which analytics alone can't provide.

  • Selection Bias in UX Research

    Every research study has bias, but you can curate and prioritize certain biases to address the questions that are important to you.

  • Independent and Dependent Variables: Increase Impact with Small Changes

    Learn how to structure your research with independent and dependent variables to increase the clarity and impact of your work.

  • Confounding Variables in Quantitative Studies

    Confounding variables interfere with quantitative studies, leading to inaccurate results. Avoid introducing such variables by randomizing your study’s conditions and keeping your research questions focused.

  • Engagement Metrics in UX

    Engagement is an abstract, complex concept used to understand how much people interact with our products. Choosing the right engagement metrics goes beyond time spent.

  • How to Use Analytics in UX

    Integrating analytics into UX work helps make data-based decisions and focuses effort on projects with the most impact.

  • Campbell's Law: The Dark Side of Success Metrics

    When organizations optimize metrics at the cost of all else, they expose themselves to metric corruption, which can have disastrous consequences.

  • Quantitative UX: Glossary

    Use this glossary to quickly clarify key terms and concepts related to quantitative user studies.

  • Long-Tail Data in UX

    The long tail refers to the data points at the trailing end of a power-law distribution. A long-tail strategy involves efficiently exploiting these low-impact data points for an aggregated benefit.

  • Confounding Variables: How to Deal with Them (Part 2 of 2)

    Confounding variables can be the result of a variety of factors, but following best practices can help avoid most of them.

  • Product-Led Growth and UX

    Product-led growth is a try-before-you-buy business strategy. Successful product-led growth relies on strong product utility and usability.

  • Confounding Variables 101 (Part 1 of 2)

    Confounding variables can affect the validity of data collected during research studies. It's important for researchers to know what they are and how to identify them.

  • Downsides of the Net Promoter Score

    The Net Promoter Score (NPS) can be gamed, and its definition loses information and precision by treating fairly dissimilar responses in the same way. It should be used together with other UX metrics rather than in isolation.

  • Product Instrumentation: 3 Benefits

    Product instrumentation tells us when and how much people use different aspects of our product. This insight can inform feature prioritization, validate our assumptions, and identify potential user problems.

  • Focus Your Design Tactics with the Pareto Principle

    A small share of all items produce most of the impact: a few features, a few usability problems, a few customers, and your key persona. Focusing design efforts on those high-impact areas leads to higher success rather than broadly (and thinly) distributed UX work.

  • CASTLE Framework for Productivity/Workplace Applications

    The HEART framework is great for B2C products but is lacking for workplace applications where users cannot choose the product. CASTLE offers a complementary assessment framework for UX that focuses on the needs of internal product teams.