Abstract: As more and more machine learning models are deployed into production, we must have better observability tools to monitor, troubleshoot, and explain their decisions. In this talk, Aparna Dhinakaran, Co-Founder, CPO of Arize AI (Ex-Uber Machine Learning), will discuss the state of the commonly seen ML Production monitoring and its challenges. She will focus on using statistical distance checks to monitor features and model output in production, analyze the effects of the changes on models, and use explainability techniques to determine if issues are model or data related.
Bio: Aparna Dhinakaran is Chief Product Officer at Arize AI; a startup focused on ML Observability. She was previously an ML engineer at Uber, Apple, and Tubemogul (acquired by Adobe). During her time at Uber, she built several core ML Infrastructure platforms, including Michaelangelo. She has a bachelor’s from Berkeley's Electrical Engineering and Computer Science program, where she published research with Berkeley's AI Research group. She is on a leave of absence from the Computer Vision Ph.D. program at Cornell University.