{"id":2330,"date":"2020-04-10T09:47:18","date_gmt":"2020-04-10T09:47:18","guid":{"rendered":"https:\/\/www.danielparente.net\/en\/?p=2330"},"modified":"2020-04-10T09:47:26","modified_gmt":"2020-04-10T09:47:26","slug":"self-supervised-learning-is-the-future-of-ai","status":"publish","type":"post","link":"https:\/\/www.danielparente.net\/en\/2020\/04\/10\/self-supervised-learning-is-the-future-of-ai\/","title":{"rendered":"Self-supervised learning is the future of AI"},"content":{"rendered":"<p>[ad_1]<br \/>\nThis is an excerpt of the article that was recollected from flipboard, as to generate a clip of interesting news from the topics that i think are important and I want to save for further references and share with my readers.<\/p>\n<div>Despite the huge contributions of deep learning to the field of artificial intelligence, there\u2019s something very wrong with it: It requires huge amounts of data. This is one thing that both<span> <\/span><a href=\"https:\/\/bdtechtalks.com\/2019\/12\/23\/yoshua-bengio-neurips-2019-deep-learning\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">the pioneers<\/a><span> <\/span>and<span> <\/span><a href=\"https:\/\/bdtechtalks.com\/2018\/02\/27\/limits-challenges-deep-learning-gary-marcus\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">critics of deep learning<\/a><span> <\/span>agree on. In fact, deep learning didn\u2019t emerge as the leading AI technique until a few years ago because of the limited availability of useful data and the shortage of computing power to process that data.<\/p>\n<p>Reducing the data-dependency of deep learning is currently among the top priorities of AI researchers.<\/p>\n<p>In his<span> <\/span><a href=\"https:\/\/www.youtube.com\/watch?v=UX8OubxsY8w\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">keynote speech at the AAAI conference<\/a>, computer scientist Yann LeCun discussed the limits of current deep learning techniques and presented the blueprint for \u201cself-supervised learning,\u201d his roadmap to solve deep learning\u2019s data problem. LeCun is one of the<span> <\/span><a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2019-03-27\/three-godfathers-of-deep-learning-selected-for-turing-award\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">godfathers of deep learning<\/a><span> <\/span>and the inventor of<span> <\/span><a href=\"https:\/\/bdtechtalks.com\/2020\/01\/06\/convolutional-neural-networks-cnn-convnets\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">convolutional neural networks (CNN)<\/a>, one of the key elements that have spurred a revolution in artificial intelligence in the past decade.<\/p>\n<p>Self-supervised learning is one of several plans to create data-efficient artificial intelligence systems. At this point, it\u2019s really hard to predict which technique will succeed in creating the next AI revolution (or if we\u2019ll end up adopting a totally different strategy). But here\u2019s what we know about LeCun\u2019s masterplan.<\/p>\n<h2>A clarification on the limits of deep learning<\/h2>\n<p>First, LeCun clarified that what is often referred to as the limitations of deep learning is, in fact, a limit of<span> <\/span><a href=\"https:\/\/bdtechtalks.com\/2020\/02\/10\/unsupervised-learning-vs-supervised-learning\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">supervised learning<\/a>. Supervised learning is the category of machine learning algorithms that require annotated training data. For instance, if you want to create an image classification model, you must train it on a vast number of images that have been labeled with their proper class.<\/p>\n<p>\u201c[Deep learning] is not supervised learning. It\u2019s not just<span> <\/span><a href=\"https:\/\/bdtechtalks.com\/2019\/08\/05\/what-is-artificial-neural-network-ann\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">neural networks<\/a>&#8230;<\/div>\n<p><a href=\"https:\/\/thenextweb.com\/neural\/2020\/04\/05\/self-supervised-learning-is-the-future-of-ai-syndication\/\" target=\"_blank\" rel=\"noopener\">Read the full article by Ben Dickson <\/a><\/p>\n<p>[ad_2]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] This is an excerpt of the article that was recollected from flipboard, as to generate a clip of interesting news from the topics that i think are important and I want to save for further references and share with my readers. Despite the huge contributions of deep learning to the field of artificial intelligence, [&hellip;]<\/p>\n","protected":false},"author":186,"featured_media":2331,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","jetpack_post_was_ever_published":false},"categories":[94,92,98],"tags":[],"class_list":["post-2330","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-data-science","category-machine-learning"],"blocksy_meta":[],"jetpack_featured_media_url":"https:\/\/e928cfdc7rs.exactdn.com\/info\/uploads\/sites\/3\/2020\/04\/Self-supervised-learning-is-the-future-of-AI.png&signature=f4f3d97db042f5fe3431fd1909f7cb61-scaled.png?strip=all","jetpack_shortlink":"https:\/\/wp.me\/p2TFCd-BA","jetpack_sharing_enabled":true,"jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts\/2330","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/users\/186"}],"replies":[{"embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/comments?post=2330"}],"version-history":[{"count":1,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts\/2330\/revisions"}],"predecessor-version":[{"id":2368,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts\/2330\/revisions\/2368"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/media\/2331"}],"wp:attachment":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/media?parent=2330"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/categories?post=2330"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/tags?post=2330"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}