US 12,112,574 B2
Systems and methods for virtual and augmented reality
Robert David Berkebile, Phoenix, MD (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by MAGIC LEAP, INC., Plantation, FL (US)
Filed on Mar. 24, 2021, as Appl. No. 17/211,502.
Claims priority of provisional application 62/994,159, filed on Mar. 24, 2020.
Prior Publication US 2021/0304509 A1, Sep. 30, 2021
Int. Cl. G06V 40/20 (2022.01); G02B 27/01 (2006.01); G06F 3/04812 (2022.01); G06F 3/04815 (2022.01); G06F 3/04842 (2022.01); G06T 7/70 (2017.01); G06T 19/00 (2011.01); G06V 10/25 (2022.01); G06V 10/44 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 40/18 (2022.01)
CPC G06V 40/20 (2022.01) [G02B 27/0172 (2013.01); G06F 3/04812 (2013.01); G06F 3/04815 (2013.01); G06F 3/04842 (2013.01); G06T 7/70 (2017.01); G06T 19/006 (2013.01); G06V 10/25 (2022.01); G06V 10/44 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 40/18 (2022.01)] 39 Claims
OG exemplary drawing
 
1. An apparatus for providing a virtual or augmented reality experience, comprising:
a screen, wherein the screen is at least partially transparent for allowing a user of the apparatus to view an object in an environment surrounding the user;
a surface detector configured to detect a surface of the object;
an object identifier configured to (1) obtain an orientation of the surface of the object and/or an elevation of the surface of the object, and (2) after the orientation and/or the elevation is obtained, determine whether the object is a wall, a floor, or a furniture based on the orientation of the surface of the object and/or the elevation of the surface of the object, wherein when the object identifier obtains the orientation and/or the elevation, an identity of the object with which the orientation and/or the elevation is associated is unknown to the object identifier; and
a graphic generator configured to generate an identifier for the object for display by the screen, the identifier indicating that the object is the wall, the floor, or the furniture, and wherein a transparent portion of the screen is configured to display the identifier.