Ronnie Kohavi discusses the impact of A/B testing on software innovation, using examples from his experience at Bing, Amazon, Microsoft, and Airbnb. He highlights the importance of testing ideas, even seemingly trivial ones, through controlled experiments.
Kohavi shares how a simple change to ad titles on Bing led to a 12% increase in revenue, emphasizing the value of A/B testing in uncovering valuable insights. He also discusses the challenges of assessing the value of ideas and the common misconception that successful features are easy to identify. Kohavi explains the structure and benefits of controlled experiments, emphasizing the need for sensitivity to detect small but significant changes and to identify unexpected consequences of feature changes.
Additionally, Kohavi addresses the cultural barriers to adopting A/B testing, such as resistance from decision-makers and fear of failure among team members. He advocates for a shift towards a more data-driven approach to decision-making and encourages experimentation as a means of continuous improvement and accelerating software innovation through A/B testing.
Switch It On With Split
The Split Feature Data Platform™ gives you the confidence to move fast without breaking things. Set up feature flags and safely deploy to production, controlling who sees which features and when. Connect every flag to contextual data, so you can know if your features are making things better or worse and act without hesitation. Effortlessly conduct feature experiments like A/B tests without slowing down. Whether you’re looking to increase your releases, to decrease your MTTR, or to ignite your dev team without burning them out–Split is both a feature management platform and partnership to revolutionize the way the work gets done. Schedule a demo to learn more.