Smart City Data Pipeline, an Edge to Core Data Story

Abstract: 

Smart Cities are complex and challenging environments. They generate an overwhelming amount of data that you have to ingest, transfer, prepare and store even before thinking of analyzing them or training a model. In this presentation based on a fictitious but concrete scenario, in the city of London, we will see how you can leverage different data engineering patterns to create a full edge-to-core data pipeline. All of these: Computer Vision, Kafka, Object Storage, Data aggregation, Real-time and Batch analysis, in a fully cloud-native containerized environment, are some of the technologies we will explore and see working live.

After this session, you should get a better understanding on how to get your models in production, how to automate some data engineering workflows, and how to build a resilient production-grade data workflow infrastructur

Bio: 

Guillaume Moutier is a Sr. Principal Data Engineering Architect at Red Hat, focusing his work on data services, AI/ML workloads and data science platforms. Former CTO of Laval University in Canada, he is constantly looking for and promoting new and innovative solutions, but always with a focus on usability and business alignment brought by 20 years of IT management experience

Open Data Science

Open Data Science
Innovation Center
101 Main St
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from Youtube
Vimeo
Consent to display content from Vimeo
Google Maps
Consent to display content from Google