Course curriculum

  • 1

    The Basics

    • Introduction

      FREE PREVIEW

    • Experimentation is a PM's flashlight

    • Why Product Managers must Experiment

    • The impact of Experimentation on Uncertainty

    • How Experimentation fits in with other data sources

    • How Experimentation fits in with other data sources
  • 2

    The Experimentation Process

    • The Experimentation Cycle

    • Observe

    • Question

    • Hypothesis

    • Prioritization

    • Experiment

    • Analyze, Document and Share, and Rollout
  • 3

    Developing an Experimentation roadmap

    • The value of an an Experimentation Roadmap for PMs

    • How to build an Experimentation roadmap and shorten Experiment time
  • 4

    Building the team

    • The Experimentation-led product team
  • 5

    Experimentation culture, communication, and documentation

    • Steps on how to nurture an Experimentation Culture

    • How to communicate launches and results

    • How to document an Experiment
  • 6

    Analyzing results

    • Frequentist: Intro to Power, Desired Confidence Level, and Sample Size

    • Frequentist: Selecting Power, Confidence Levels, and Minimum detectable effects

    • Frequentist: Statistical and Practical Significance

    • Sequential and the multiple comparisons problem

    • Intro to Bayesian

    • Sample Ratio Mismatch and Experiment Interaction
  • 7

    Further reading

    • Useful links