This event has ended. Visit the official site or create your own event on Sched.
Back To Schedule
Friday, May 18 • 10:00am - 11:40am
The Joy of Proving Yourself Wrong: A Case Study in A/B Experimentation

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
It’s hard to run an experiment perfectly. Let’s talk about how to recover when something goes wrong.
Setting up an A/B test is easy, but even the most experienced teams are occasionally surprised by unexpected complications mid-experiment. Using a case study, we’ll discuss some common surprises and how to recover from, and eventually prevent, them.

Through this interactive session, we'll go through a recent experiment my team ran and you'll have a chance to set the variables up yourself. We'll learn about how complicated these experiments can get and how to discover if you've made an error in your test setup. You'll be surprised along the way by some of the very same challenges we ran into, and be asked to decide what kind of fix to do. Finally, I'll share operational processes I've put in place on my team to reduce the likelihood of these surprises in the future.

Make sure that if your hypothesis fails, it’s due to customer behavior, not a bump in the road or an error in your team's processes.

avatar for Jenny Wanger

Jenny Wanger

Product Manager, SpotHero
Jenny Wanger is a senior product manager for SpotHero, a top-ranking app that helps people park easier. Her years of product management experience prior to that include running the developer experience team at Arity, a startup founded by Allstate in downtown Chicago, and consulting... Read More →

Friday May 18, 2018 10:00am - 11:40am EDT
Conference Room D