Concept
Experimentation Velocity
Designing experiments to fail conclusively to maximize learning
Experimentation Velocity
10 visible of 22 connections
Related Concepts9
Related Frameworks20
Related Practices51
Ask about this concept
Transcript mentions
Yeah, exactly right. In my experience, the typical win rate, and I hate to use that term for experiments, is often something like 30 to 50%.
I do think though, and we do this every now and then with the streak, eventually you just hit a local maxima, and you say, you talked about launching neutral experiments, this is a great example, where it's like all right, cool, now we…
And I think his point was like, look, we can debate this forever. So I would rather us see the upper and lower bounds of how good this could be or how bad this is going to be immediately.
Two is being decisive. We have tons of data, but it's not always clear exactly what to do with that, or we're using a new input.
… area I want to chat about is experimentation and growth and data, which makes sense if strong perspectives is on being the new head of growth amplitude. So maybe we start with experimentation.
Concept
Experimentation Velocity
Designing experiments to fail conclusively to maximize learning
Related Concepts9
Related Frameworks20
Related Practices51
Ask about this concept
Transcript mentions
Yeah, exactly right. In my experience, the typical win rate, and I hate to use that term for experiments, is often something like 30 to 50%.
I do think though, and we do this every now and then with the streak, eventually you just hit a local maxima, and you say, you talked about launching neutral experiments, this is a great example, where it's like all right, cool, now we…
And I think his point was like, look, we can debate this forever. So I would rather us see the upper and lower bounds of how good this could be or how bad this is going to be immediately.
Two is being decisive. We have tons of data, but it's not always clear exactly what to do with that, or we're using a new input.
… area I want to chat about is experimentation and growth and data, which makes sense if strong perspectives is on being the new head of growth amplitude. So maybe we start with experimentation.