{"id":772,"date":"2019-12-09T19:09:07","date_gmt":"2019-12-09T19:09:07","guid":{"rendered":"https:\/\/www.danielparente.net\/en\/2019\/12\/09\/google-arcore-phones-can-detect-depth-with-single-camera\/"},"modified":"2019-12-09T19:09:07","modified_gmt":"2019-12-09T19:09:07","slug":"google-arcore-phones-can-detect-depth-with-single-camera","status":"publish","type":"post","link":"https:\/\/www.danielparente.net\/en\/2019\/12\/09\/google-arcore-phones-can-detect-depth-with-single-camera\/","title":{"rendered":"Google ARCore phones can detect depth with single camera"},"content":{"rendered":"

[ad_1]
\n<\/p>\n

\n

ARCore<\/a> is Google\u2019s platform<\/a> for augmented reality available to Android and iOS apps. To allow for more immersive experiences, a new ARCore Depth API allows any compatible phone to create depth maps from a single camera.<\/p>\n

\n

The ARCore Depth API allows developers to use our depth-from-motion algorithms to create a depth map using a single RGB camera. The depth map is created by taking multiple images from different angles and comparing them as you move your phone to estimate the distance to every pixel.<\/p>\n<\/blockquote>\n

One principle that makes AR more realistic is occlusion, or the \u201cability for digital objects to accurately appear in front of or behind real-world objects.\u201d It lets applications make sure objects are not just floating in space or placed in a physically impossible position. This is particularly useful for making apps that let you demo furniture in your living room more realistic.<\/p>\n

The example below is an updated version of AR animals in Google Search<\/a>. The cat \u2014 with its hind legs hidden \u2014 appears behind the furniture instead of just standing<\/em> in front of wherever you point the camera. It\u2019s treating the background as being 3D with depth, not just as a flat surface. This more realistic experience will begin rolling out to some of the 200 million ARCore-enabled Android devices with the Google app today.<\/p>\n

\n
\n
\n
\"Occlusion<\/a> <\/p>\n

Occlusion off <\/p>\n<\/p><\/div>\n<\/p><\/div>\n

<\/p>\n

\n
\"Occlusion<\/a> <\/p>\n

Occlusion on <\/p>\n<\/p><\/div>\n<\/p><\/div>\n

<\/div>\n

<\/div>\n

\u201cHaving a 3D understanding of the world\u201d makes possible a number of other use cases. Google has explored (examples below) realistic physics, path planning, and surface interaction with ARCore\u2019s new depth capability.<\/p>\n

This one lens approach lowers the barrier to the technology by not requiring specialized cameras and sensors. That said, the Depth API will only improve with better hardware in phones. Google is letting developers collaborate<\/a> on the new ARCore Depth API today.<\/p>\n

\n

For example, the addition of depth sensors, like time-of-flight (ToF) sensors, to new devices will help create more detailed depth maps to improve existing capabilities like occlusion, and unlock new capabilities such as dynamic occlusion \u2014 the ability to occlude behind moving objects.<\/p>\n<\/blockquote>\n

\n
\n
\n
\"google-arcore-depth-2\"<\/a> <\/div>\n<\/p><\/div>\n

<\/p>\n

\n
\"google-arcore-depth-1\"<\/a> <\/div>\n<\/p><\/div>\n

<\/div>\n

<\/div>\n