{"id":1597,"date":"2020-01-31T06:59:21","date_gmt":"2020-01-31T06:59:21","guid":{"rendered":"https:\/\/www.danielparente.net\/en\/2020\/01\/31\/openai-goes-all-in-on-facebooks-pytorch-machine-learning-framework\/"},"modified":"2020-01-31T06:59:21","modified_gmt":"2020-01-31T06:59:21","slug":"openai-goes-all-in-on-facebooks-pytorch-machine-learning-framework","status":"publish","type":"post","link":"https:\/\/www.danielparente.net\/en\/2020\/01\/31\/openai-goes-all-in-on-facebooks-pytorch-machine-learning-framework\/","title":{"rendered":"OpenAI goes all-in on Facebook&#8217;s Pytorch machine learning framework"},"content":{"rendered":"<p> [ad_1]<br \/>\n<br \/><img decoding=\"async\" src=\"https:\/\/cdn.flipboard.com\/venturebeat.com\/49d80bfda94a46dbfd59776eef8615d9a9de6133\/original.jpg\" \/><\/p>\n<div>\n<p>In what might only be perceived as a win for Facebook, OpenAI today announced that it will migrate to the social network\u2019s PyTorch machine learning framework in future projects, eschewing Google\u2019s long-in-the-tooth TensorFlow platform. OpenAI is the San Francisco-based AI research firm cofounded by CTO Greg Brockman, chief scientist Ilya Sutskever, Elon Musk, and others, with backing from luminaries like LinkedIn cofounder Reid Hoffman and former Y Combinator president Sam Altman. In a <a href=\"https:\/\/openai.com\/blog\/openai-pytorch\/\" target=\"_blank\" rel=\"noopener\">blog post<\/a>, the company cited PyTorch\u2019s efficiency, scalability, and adoption as the reasons for its decision.<\/p>\n<p>\u201cGoing forward we\u2019ll primarily use PyTorch as our deep learning framework but sometimes use other ones when there\u2019s a specific technical reason to do so,\u201d said the company in a statement. \u201cWe\u2019re \u2026 excited to be joining a rapidly-growing developer community, including organizations like Facebook and Microsoft, in pushing scale and performance on [graphics cards].\u201d<\/p>\n<p>OpenAI says that many of its teams have already migrated their work to PyTorch and that they\u2019ll contribute to the PyTorch community in the coming months. Additionally, the company says it plans to make available its <a href=\"https:\/\/venturebeat.com\/2018\/11\/08\/openai-launches-reinforcement-learning-training-to-prepare-for-artificial-general-intelligence\/\" target=\"_blank\" rel=\"noopener\">Spinning Up in Deep RL<\/a> educational resource on PyTorch in early 2020, after which point it intends to investigate scaling AI systems with data parallel training, visualizing those systems with model interpretability, and building general-purpose robotics frameworks. (OpenAI is in the process of writing PyTorch bindings for its highly optimized blocksparse kernels, and it says it\u2019ll open-source those bindings in the coming months.)<\/p>\n<p>PyTorch, which Facebook publicly released in October 2016, is an open source machine learning library based on Torch, a scientific computing framework and script language that\u2019s in turn based on the Lua programming language. As of March 2018, it incorporates Caffe2, a deep learning toolset pioneered by University of California, Berkeley researchers and further developed by Facebook\u2019s AI Research lab.<\/p>\n<p>While TensorFlow has been around slightly longer (since November 2015), PyTorch continues to see rapid uptake in the data science and developer community. It claimed one of the top spots for fastest-growing open source projects in the past 12 months, according to GitHub\u2019s 2018 Octoverse report. Facebook recently <a href=\"https:\/\/pytorch.org\/blog\/pytorch-1-dot-3-adds-mobile-privacy-quantization-and-named-tensors\/\" target=\"_blank\" rel=\"noopener\">revealed<\/a> that in 2019 the number of contributors to the platform grew more than 50% year-over-year to nearly 1,200. An <a href=\"https:\/\/thegradient.pub\/state-of-ml-frameworks-2019-pytorch-dominates-research-tensorflow-dominates-industry\/\" target=\"_blank\" rel=\"noopener\">analysis<\/a> conducted by The Gradient found that every major AI conference in 2019 has had a majority of papers implemented in PyTorch, and O\u2019Reilly <a href=\"https:\/\/www.oreilly.com\/ideas\/one-simple-graphic-researchers-love-pytorch-and-tensorflow\" target=\"_blank\" rel=\"noopener\">noted<\/a> that PyTorch citations in papers grew by more than 194% in the first half of 2019 alone.<\/p>\n<p>Unsurprisingly, a number of leading machine learning software projects are built on top of PyTorch, including Uber\u2019s Pyro and HuggingFace\u2019s Transformers. Software developer Preferred Networks joined the ranks recently with a pledge to move from its bespoke AI development framework, Chainer, to PyTorch in the near future.<\/p>\n<\/p><\/div>\n<p>[ad_2]<br \/>\n<br \/><a href=\"https:\/\/venturebeat.com\/2020\/01\/30\/openai-facebook-pytorch-google-tensorflow\/\" target=\"_blank\" rel=\"noopener\">Original article by  Kyle Wiggers  <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] In what might only be perceived as a win for Facebook, OpenAI today announced that it will migrate to the social network\u2019s PyTorch machine learning framework in future projects, eschewing Google\u2019s long-in-the-tooth TensorFlow platform. OpenAI is the San Francisco-based AI research firm cofounded by CTO Greg Brockman, chief scientist Ilya Sutskever, Elon Musk, and [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1598,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","jetpack_post_was_ever_published":false},"categories":[94,92,98],"tags":[],"class_list":["post-1597","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-data-science","category-machine-learning"],"blocksy_meta":[],"jetpack_featured_media_url":"https:\/\/e928cfdc7rs.exactdn.com\/info\/uploads\/sites\/3\/2020\/01\/OpenAI-goes-all-in-on-Facebooks-Pytorch-machine-learning-framework-scaled.jpg?strip=all","jetpack_shortlink":"https:\/\/wp.me\/p2TFCd-pL","jetpack_sharing_enabled":true,"jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts\/1597","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/comments?post=1597"}],"version-history":[{"count":0,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/posts\/1597\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/media\/1598"}],"wp:attachment":[{"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/media?parent=1597"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/categories?post=1597"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.danielparente.net\/en\/wp-json\/wp\/v2\/tags?post=1597"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}