Key Design Principles for the Modern Data Engineering Stack

Abstract: 

Data platforms come in different shapes and sizes. One thing that is often overlooked is that just because a design pattern works for Netflix or Airbnb or Canva, does not mean it will necessarily work for you. The design of your data platform has to be tailored to your business and use-cases. In this talk, I take you through key design principles to think about when designing your data platform. I use a data platform design pattern that I have implemented for Blike, a FinTech startup specialising in cycle-to-work schemes, to demonstrate that less is more.

Bio: 

Jonathan is an Analytics Engineer at Canva where he is building data platforms to empower product teams to unlock insights from millions of users.
He has previously worked at EY, Telstra Purple, and Mantel Group, where he has led data engineering teams, built data engineering platforms for ASX-100 customers, and developed new products and businesses. Since 2020, Jonathan has trained over 100 students through data analytics bootcamps and courses. In 2022, he founded Data Engineer Camp, a 14-week data engineering bootcamp that empowers professionals to become data engineers with the modern data stack.
He also hosts the Perth Data Engineering monthly meetup group with over 300 members.

Open Data Science

 

 

 

Open Data Science
One Broadway
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from Youtube
Vimeo
Consent to display content from Vimeo
Google Maps
Consent to display content from Google