Once you’ve found your riskiest assumptions you’ll need a way to figure out how best to test and measure them in a quantitative way. The experiment canvas, created by Ash Maurya, provides a straightforward way to break down your assumptions into measurable, observable, experiments.Free download
How to use the canvas
The purpose of the experiment canvas is to design the right experiment at the right time, facilitating a team to have the right conversation. With the experiment canvas, it is easy to design a well-defined experiment: starting with identifying the current riskiest assumption, then specifying a clear, falsifiable hypothesis and experiment setup. After running the experiment, check the results and plan your next steps.
Your hypothesis is a statement you believe to be true about your riskiest assumption. Write it down before you run the experiment. It is too easy to change the conditions afterward to make the data fit, and this robs you of valuable insight.
Quantify your hypothesis. How many customers will do it? How many times? In what timeframe? It’s okay to use a bandwidth for this, as long as you specify it upfront. The metrics you define need to be actionable (i.e., they need to directly relate to the hypothesis) and, accessible (i.e., you need to be able to see the results).
Link the numbers back to the assumption you are testing. Why does having 10 positive results validate your assumption? Specify any qualitative outcomes and variables. What different answers you are expecting? How will you cluster them?
Armed with this hypothesis you’re ready to start your experiment. Track the data immediately and write everything down, so that later you can check if you interpreted the results correctly.
Use the hypothesis formula: “We believe (specific testable action) will drive (specific measurable outcome) within (timeframe)”
1. Riskiest assumption
What is the riskiest assumption you want to validate? And why is it so important?
2. Falsifiable hypothesis
Declare the expected outcome beforehand. Try to have a good estimate rather than fake precision!
3. Experiment setup
What is the prototype you will use to test with? What are the important variables and metrics? Is it quantitative or qualitative?
Enter the qualitative and/or quantitative data resulting from your experiment.
Summarize your findings. Did your result validate or invalidate the hypothesis? Or was it inconclusive?
6. Next steps
Do you need to pivot, persevere, or redo the experiment?
Step by step guide
Before you start
Arrange for a comfortable environment. Definitely not a meeting room. Make sure you have already found your riskiest assumption.
⊗ Arrange a relaxed, positive and private environment
⊗ Have markers (fine tip) and paper for everybody
⊗ Print or draw the canvas on a big sheet of paper
⊗ Have plenty of sticky notes and markers ready
⊗ Allow yourself 45 minutes of undisturbed time
Define the experiment
Go over the sections on the left side of the canvas. Come up with a hypothesis first, and then try to figure out what you need (in terms of a prototype setup) to test that hypothesis. Have a look at the Prototype canvas for inspiration.
⊗ You have created a falsifiable hypothesis to test the riskiest assumption with
⊗ Your hypothesis fits the template
⊗ You defined measurable outcomes
⊗ You created a prototype
Run the experiment
Run the experiment for the time you specified, and collect the data.
Draw your conclusions
Based on the data, decide if your hypothesis was validated or invalidated – or that your experiment was inconclusive.
Go over the Design Criteria, and make them S.M.A.R.T. (Specific, Measurable, Achievable, Relevant, Time-bound). If necessary, replace the post-its with better defined ones. Keep a note of the SMART Design Critera.
⊗ Pivot, persevere, or redo
⊗ Use the Validation canvas to track your progress