In this session of Machine Learning Tech Talks, Software Engineer from Google Research, Iulia Turc, goes through the recent history of natural language processing, including the current state of the art architecture, the Transformer.
- 0:00 – Intro
- 1:07 – Encoding text
- 8:21 – Language modeling & transformers
- 29:46 – Transfer learning & BERT
- 43:55 – Conclusion