An introduction to Transfer learning and Transformer models in Natural Language Processing (NLP)

In this session of Machine Learning Tech Talks, Software Engineer from Google Research, Iulia Turc, goes through the recent history of natural language processing, including the current state of the art architecture, the Transformer.

Video Index

• 0:00 – Intro
• 1:07 – Encoding text
• 8:21 – Language modeling & transformers
• 29:46 – Transfer learning & BERT
• 43:55 – Conclusion