US 12,387,424 B2
Generating and modifying an artificial reality environment using occlusion surfaces at predetermined distances
Gregory Mayo Daly, Seattle, WA (US); and Nicholas McGee, Seattle, WA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Jan. 19, 2023, as Appl. No. 18/157,003.
Application 18/157,003 is a continuation of application No. 17/356,427, filed on Jun. 23, 2021, granted, now 11,562,529.
Prior Publication US 2023/0162436 A1, May 25, 2023
Int. Cl. G06T 15/00 (2011.01); G06T 7/50 (2017.01); G06T 15/20 (2011.01); G06T 19/00 (2011.01); G06F 3/01 (2006.01)
CPC G06T 15/205 (2013.01) [G06T 7/50 (2017.01); G06T 19/006 (2013.01); G06F 3/012 (2013.01); G06F 3/013 (2013.01); G06T 2210/64 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising, by a computing system:
generating a depth map of a real environment as seen from a viewpoint of a user, the depth map comprising pixels having corresponding depth values of one or more physical objects in the real environment;
generating, based on the depth map, a first two-dimensional occlusion mask representing at least a visible portion of the one or more physical objects that are located within a first predetermined depth range defined relative to the viewpoint;
generating, based on the depth map, a second two-dimensional occlusion mask representing at least a visible portion of the one or more physical objects that are located within a second predetermined depth range defined relative to the viewpoint, wherein a minimum depth of the second predetermined depth range is greater than a maximum depth of the first predetermined depth range;
posing the first and second two-dimensional occlusion masks in a three-dimensional coordinate system;
determining a visibility of a virtual object relative to the one or more physical objects by comparing a model of the virtual object with the first and second two-dimensional occlusion masks; and
generating an output image based on the determined visibility of the virtual object.