Concept

Experimentation Velocity

Designing experiments to fail conclusively to maximize learning

Preparing graph…
100%
Concept

Experimentation Velocity

10 visible of 22 connections

Ask about this concept

Transcript mentions

  • Yeah, exactly right. In my experience, the typical win rate, and I hate to use that term for experiments, is often something like 30 to 50%.

  • I do think though, and we do this every now and then with the streak, eventually you just hit a local maxima, and you say, you talked about launching neutral experiments, this is a great example, where it's like all right, cool, now we…

  • And I think his point was like, look, we can debate this forever. So I would rather us see the upper and lower bounds of how good this could be or how bad this is going to be immediately.

  • Two is being decisive. We have tons of data, but it's not always clear exactly what to do with that, or we're using a new input.

  • … area I want to chat about is experimentation and growth and data, which makes sense if strong perspectives is on being the new head of growth amplitude. So maybe we start with experimentation.