Beyond Simple A/B Testing: Advanced Experimentation Tactics


A/B testing is rapidly establishing itself as a core tool in product development. In this talk, we will start with a recap of standard A/B testing, including best practices. We'll also explore cutting-edge, less-familiar but powerful methodologies which address well-known limitations of standard A/B Testing. These include Sequential Testing, Multi-Armed Bandits, Switchback Experiments, Stratified Sampling, Heterogeneous Effects Detection and Experimental meta-analysis. Designed for data professionals and product builders, this presentation aims to inspire the embrace of innovative approaches and provide insights into the frontiers of experimentation.Beyond Simple A/B Testing: Advanced Experimentation Tactics


Liz Obermaier is a Data Scientist at Statsig who is passionate about leveraging data to drive innovation and enhance user experiences. Statsig provides product observability and experimentation services to top companies such as OpenAI, Notion, RecRoom, Univision, and Ancestry. Before joining Statsig, she was a Data Scientist at Facebook (now Meta), where she was involved in building products for the Quest 2 and Quest Pro VR devices. She holds a degree in Math with Computer Science and Business Analytics from MIT. In her free time, Liz can be found hanging out with her dog, Kiwi, who is very polite and never barks during meetings.

Open Data Science




Open Data Science
One Broadway
Cambridge, MA 02142

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google