{"id":5296,"date":"2021-07-22T18:50:22","date_gmt":"2021-07-22T18:50:22","guid":{"rendered":"https:\/\/www.danielparente.net\/en\/2021\/07\/22\/an-introduction-to-transfer-learning-and-transformer-models-in-natural-language-processing-nlp\/"},"modified":"2021-07-22T18:50:22","modified_gmt":"2021-07-22T18:50:22","slug":"an-introduction-to-transfer-learning-and-transformer-models-in-natural-language-processing-nlp","status":"publish","type":"post","link":"https:\/\/www.danielparente.net\/en\/2021\/07\/22\/an-introduction-to-transfer-learning-and-transformer-models-in-natural-language-processing-nlp\/","title":{"rendered":"An introduction to Transfer learning and Transformer models in Natural Language Processing (NLP)"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In this session of Machine Learning Tech Talks, Software Engineer from Google Research, Iulia Turc, goes  through the recent history of natural language processing, including the current state of the art architecture, the Transformer. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Video Index<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li><a href=\"\">0:00<\/a> &#8211; Intro <\/li><li><a href=\"\">1:07<\/a> &#8211; Encoding text <\/li><li><a href=\"\">8:21<\/a> &#8211; Language modeling &amp; transformers <\/li><li><a href=\"\">29:46<\/a> &#8211; Transfer learning &amp; BERT <\/li><li><a href=\"\">43:55<\/a> &#8211; Conclusion<\/li><\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe class=\"youtube-player\" width=\"1290\" height=\"726\" src=\"https:\/\/www.youtube.com\/embed\/LE3NfEULV6k?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this session of Machine Learning Tech Talks, Software Engineer from Google Research, Iulia Turc, goes through the recent history of natural language processing, including the current state of the art architecture, the Transformer. Video Index 0:00 &#8211; Intro 1:07 &#8211; Encoding text 8:21 &#8211; Language modeling &amp; transformers 29:46 &#8211; Transfer learning &amp; BERT [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","jetpack_post_was_ever_published":false},"categories":[94,98,859],"tags":[955,2519,4600],"class_list":["post-5296","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-machine-learning","category-natural-language-processing","tag-ai-and-machine-learning","tag-natural-language-processing","tag-nlp"],"blocksy_meta":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p2TFCd-1nq","jetpack_sharing_enabled":true,"jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts\/5296","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/comments?post=5296"}],"version-history":[{"count":0,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts\/5296\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/media?parent=5296"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/categories?post=5296"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/tags?post=5296"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}