Abstract: Anomalies, often referred to as outliers, are data points or patterns in data that do not conform to a notion of normal behavior. Automatically detecting and correctly classifying something unseen as anomalous is a challenging problem that has been tackled in many different manners over the years. Traditional machine learning approaches are sub-optimal when it comes to high dimensional data, because they fail to capture the complex structure in the data. This is where deep learning methods can be leveraged for the task.
This talk reviews a set of relevant deep learning model architectures including autoencoders, variational auto-encoders, generative adversarial networks and sequence-to-sequence methods, and addresses how they can be applied to the task of anomaly detection, comparing them in terms of training, inference and storage costs. Anomaly detection using each of these models is explored as a function of how they can be applied to first model normal behavior, and then this knowledge is exploited to identify deviations.
In addition, we provide practical guidance for the successful implementation of anomaly detection systems within enterprises across key metrics like interpretability, reduction of false positives and scalability. We show benchmark results from applying them using several datasets and discuss industry best practices for deploying each model. Finally, we provide intuition for how and why these algorithms work by demoing them with a working prototype.
- Why and when to use deep learning for anomaly detection
- In depth coverage of various deep learning approaches and how they can be applied for anomaly detection
- Performance benchmark for various deep learning models for a given dataset
- Example use cases, product possibilities and best practices.
Bio: Nisha Muktewar is a Research Engineer at Cloudera Fast Forward Labs, where she spends time researching latest ideas in machine learning, builds prototypes that showcase these capabilities when applied to real-world use cases, and advises clients in this space. Prior to joining Cloudera, she worked as a Manager in Deloitte’s Actuarial & Modeling practice leading teams in designing, building, and implementing predictive modeling solutions for pricing, consumer behavior, marketing mix, and customer segmentation use cases for insurance and retail/consumer businesses.