US 12,236,541 B2
Geometry-aware augmented reality effects with real-time depth map
David Kim, Zug (CH); and Ruofei Du, San Francisco, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Appl. No. 17/998,736
Filed by GOOGLE LLC, Mountain View, CA (US)
PCT Filed May 29, 2020, PCT No. PCT/US2020/070094
§ 371(c)(1), (2) Date Nov. 14, 2022,
PCT Pub. No. WO2021/242327, PCT Pub. Date Dec. 2, 2021.
Prior Publication US 2023/0206567 A1, Jun. 29, 2023
Int. Cl. G06T 19/00 (2011.01); G06T 7/50 (2017.01); G06T 15/06 (2011.01); G06T 15/60 (2006.01); G06T 17/20 (2006.01)
CPC G06T 19/006 (2013.01) [G06T 7/50 (2017.01); G06T 15/06 (2013.01); G06T 15/60 (2013.01); G06T 17/20 (2013.01); G06T 2200/28 (2013.01); G06T 2207/10028 (2013.01); G06T 2210/21 (2013.01); G06T 2215/12 (2013.01); G06T 2215/16 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
generating a triangular mesh representing a physical environment and a depth map of the physical environment, the triangular mesh including a plurality of vertices, the depth map including a plurality of depth values;
performing a displacement operation on the plurality of vertices of the triangular mesh including removing a vertex of the plurality of vertices of the triangular mesh in response to the depth map satisfying a criterion to produce a plurality of displaced vertices representing a geometry of at least one real object within the physical environment;
receiving virtual object data representing a virtual object configured to be displayed with the at least one real object in the physical environment; and
displaying the virtual object in the physical environment on a display to produce a displayed virtual object, the displayed virtual object having a difference from the virtual object according to the plurality of displaced vertices.