Deep Transfer Learning for Computer Vision: Real-World Applications at Nanoscale
Deep Transfer Learning for Computer Vision: Real-World Applications at Nanoscale


There has been huge advancements in the field of Artificial Intelligence in the last decade. While this has been fueled by better compute, more data and cheaper storage, the real success which has revolutionized AI applications is a combination of deep learning and transfer learning. This session will give a gentle introduction to deep learning, deep transfer learning, cover its scope, advantages, applications and limitations. We will then do a deep-dive into three industry focused use-cases pertaining to Semiconductors and Manufacturing where we have leveraged a combination of deep transfer learning and traditional computer vision to solve these challenging, yet interesting problems at nanoscale.

Chip and equipment manufacturing is a tough task given the strict adherence to quality standards and processes like six-sigma control checks. In this session, we will be looking at ways in which we leveraged a combination of traditional image processing and computer vision techniques and coupled it with the power of deep transfer learning and deep learning methodologies including classification, clustering, object detection and text recognition. Following is a brief on the three use-cases we will be covering in the session:
Automated Defect Classification at Nanoscale: EUV masks are critical towards manufacturing of integrated circuit designs. Defects in these masks can be highly costly as they end up degrading the quality of manufactured wafers. Leveraging a combination of traditional image processing, classification and object recognition coupled with deep transfer learning, we will look at how to detect defects at nanoscale from low-resolution scanner images and classify them using a hierarchical multi-level classifier.
Automated Defect Clustering at Nanoscale: Masks are critical to ensure the right patterns are formed on wafer during the manufacturing processed. However there are a wide variety of defects which could occur in these masks. These defects need to be detected and analyzed by process engineers. Classification works well when you know what defects to look at, but how do you deal with unknowns? This is where we leveraged a combination of deep transfer learning coupled with unsupervised learning to build an automated defect clustering solution
Generic Optical Character Recognition for Inventory Tracking: Typically there are a wide variety of inventory equipment which needs to be tracked based on artifacts like barcodes, engraved text, printed text and so on. Usually these artifacts vary across equipment in the form of various formats, shapes, sizes, orientation and textures. We will talk about a generic optical character recognition system which leverages traditional image processing techniques as well as deep learning based object detection models to extract text from equipment with varying formats.
This is going to be a practitioner-focused talk so we will be looking at how deep transfer learning coupled with traditional computer vision has been leveraged for solving the above use-cases and also discuss on model architectures, tools and techniques which were used in the process.


Sachin is a Deputy Director at Applied Materials leading efforts in Data Science and Advanced Analytics with a team of data scientists, working to provide innovative solutions with a focus on AI enablement in various products and systems for the semiconductor equipment manufacturing industry. He has a BS in Information Technology and over 15 years of diverse experience in the Industry around Software, Data Science and Artificial Intelligence.

Open Data Science




Open Data Science
One Broadway
Cambridge, MA 02142

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google