10 Things You Didn’t Know About TensorFlow in Production
10 Things You Didn’t Know About TensorFlow in Production


In this talk, I highlight 10 powerful, yet unknown, aspects of TensorFlow based on years of profiling, tuning, and debugging CPU/GPU/TPU-based TensorFlow in production.

Key takeaways include techniques for profiling and tuning TensorFlow Core, TensorFlow Serving, and TensorFlow Lite.

In addition to model training optimizations such as batch normalization and XLA, I demonstrate post-training optimizations including 8-bit quantization and layer-fusing.

Data Analysts, Software Engineers, Research Engineers, Data Scientists, Application Engineers, DevOps

""If you can't observe, you can't improve."" Attendees will learn how to profile, monitor, and improve TensorFlow models through the entire AI pipeline including both model training and model serving.

The audience should be familiar with the basic concepts of neural networks and TensorFlow.


Chris Fregly is Founder and Applied AI Engineer at PipelineAI, a Real-Time Machine Learning and Artificial Intelligence Startup based in San Francisco. He is also an Apache Spark Contributor, a Netflix Open Source Committer, founder of the Global Advanced Spark and TensorFlow Meetup, author of the O’Reilly Training and Video Series titled, "High Performance TensorFlow in Production with Kubernetes and GPUs." Previously, Chris was a Distributed Systems Engineer at Netflix, a Data Solutions Engineer at Databricks, and a Founding Member and Principal Engineer at the IBM Spark Technology Center in San Francisco.

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google