US 12,307,575 B2
Scene capture via artificial reality systems
Gioacchino Noris, Zurich (CH); Sony Nguyen, San Jose, CA (US); Andrea Alejandra Cohen, Redwood City, CA (US); Anush Mohan, San Jose, CA (US); and Matthew Banks, Kirkland, WA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Oct. 19, 2022, as Appl. No. 17/969,622.
Claims priority of provisional application 63/272,092, filed on Oct. 26, 2021.
Prior Publication US 2023/0127307 A1, Apr. 27, 2023
Int. Cl. G06T 15/06 (2011.01); G06T 15/08 (2011.01); G06T 17/00 (2006.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01)
CPC G06T 15/06 (2013.01) [G06T 15/08 (2013.01); G06T 17/00 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01); G06T 2200/24 (2013.01); G06T 2210/12 (2013.01); G06T 2219/004 (2013.01); G06T 2219/2004 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising, by a computing system:
initiating a scene capture process to capture a scene of a physical environment surrounding a user wearing an artificial-reality system, the scene comprising one or more of planes or objects;
sending a first set of instructions to the user to outline one or more planes of the scene;
casting a first set of rays to outline the one or more planes according to the first set of instructions;
creating one or more plane anchors corresponding to the one or more planes based on outlining by the first set of rays;
sending a second set of instructions to the user to outline one or more objects of the scene;
casting a second set of rays to outline the one or more objects according to the second set of instructions;
creating one or more object anchors corresponding to the one or more objects based on outlining by the second set of rays;
generating a scene model of the scene based on the one or more plane anchors and the one or more object anchors; and
providing a subset of the one or more plane anchors and/or the one or more object anchors, of the scene model, to a client application, responsive to a query by the client application for the subset of the one or more plane anchors and/or the one or more object anchors,
wherein the client application generates an artificial reality environment using the subset of the one or more plane anchors and/or the one or more object anchors of the scene model.