Abstract: 

Welcome to the world of augmented reality and artificial intelligence! In this workshop, we demonstrate AR and AI via hands-on exercises where you will interact with your augmented world. We describe some of the novel applications of AR+AI, their limitations, and social impacts amplified by the COVID-19 pandemic. We leave attendees armed with code, inspiration and ethical considerations for future projects.
In this workshop, you will build an application where: you will take your own snapshot using your webcam and use deep learning to augment your background; you will use deep learning again to perform pose estimation in your augmented world. We will discuss ethical challenges associated with using deep learning and provide resources and guidance on this topic.
In deep learning, we will focus on two techniques: keypoint estimation using a deep neural network, and segmentation. Keypoint estimation recognizes specific points in an image – for example, the locations of joints on the body. Image segmentation separates parts of an image, pixel-by-pixel. For example, segmentation can be used to identify the background pixels in an image.
We will set you up for success to take on challenging projects in this domain. A clear and precise instruction sheet will guide you through exercises ranging from beginner to intermediate level. This workshop is highly interactive with hands-on exercises in which you will incrementally build the pieces of an AR+AI application and test it out. The presentation that accompanies the exercises demonstrates how powerful applications ranging from entertainment to healthcare can be built using the same components that we taught.

Bio: 

Shruti Karulkar is the Quality Engineering Manager MATLAB Hardware at MathWorks. Shruti's team of highly creative engineers work to design and implement cutting-edge tools to qualify MATLAB and Simulink support for hardware ranging from simple - Arduino/Raspberry Pi/iOS and Android phones - to high-end RF Signal Generators. Shruti has a long history of serving as a STEM mentor and is a STEM Ambassador for MathWorks. Shruti was a speaker at GHC18, GHC19 and GHC20 delivering successful and popular hands-on AI workshops.