Streamlining Your Streaming Analytics with Delta Lake & Rust


As organizations attempt to optimize their technology investments and capabilities in cloud infrastructure and data processing frameworks, the potential for an isolated approach to solving data problems (such as streaming analytics) can arise. Open source to the rescue! In this session, we demonstrate how to get started with a streaming architecture using Delta Lake and Kafka on Azure. However, rather than ingesting data into Delta Lake via Spark jobs, we are going to use a couple of open-source libraries (yeah, no Spark required...some restrictions apply). By the end of this session you'll walk away with a playbook for up-leveling your streaming analytics architecture that includes:

· Lakehouse implementation via Delta Lake

· Kafka streaming via kafka-delta-ingest

· python binding via delta-rs

· Data storage on Azure via blob and ADLS


Gary Nakanelua is a professional technologist with over 17 years of experience and the author of Experiment or Expire. Gary is the Managing Director of Innovation at Blueprint, a data intelligence company based in Bellevue, WA. He’s responsible for the experimentation and creation of Blueprint’s transformative solutions and accelerators. With his diverse background, Gary brings a different perspective to problems that businesses are facing today to create quantifiable solutions driven through a high level of collaborative thought processing, strategic planning, and cannibalization.

Open Data Science




Open Data Science
One Broadway
Cambridge, MA 02142

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google