What are Transformers and How do They Work?
What are Transformers and How do They Work?

Abstract: 

In this workshop, I would be talking about transformers and their inner workings. I would in fact review two google papers:

- Presentation: Attention is what you need.
- NB: Create Translator from Scratch.
- Presentation: BERT Transformers.
- NB: How to Use BERT for a task. like QA or Classification.

Session Outline
In this workshop I would be talking about transformers and their inner workings. I would in fact review two google papers:

- Module 1: What are transformers?
Presentation: Attention is what you need.
NB: Create Translator from Scratch.

- Module 2: What is BERT?
Presentation: BERT Transformers
NB: How to Use BERT for a task like Question answering or Classification.

I would need more time to structure this more.

Background Knowledge
Basic NLP,
Deep Learning,
LSTM

Bio: 

Rahul Agarwal is currently working as a Machine Learning Engineer at Facebook. Before this he has worked at WalmartLabs and Citi India.
In his free time Rahul likes to write about Data Science and Machine Learning and you could find him at Medium, his own Website, or linkedin profile which is the place where he is the most active.

Open Data Science

Open Data Science
Innovation Center
101 Main St
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from Youtube
Vimeo
Consent to display content from Vimeo
Google Maps
Consent to display content from Google