US 12,475,656 B2
Space and content matching for augmented and mixed reality
Erika Varis Doggett, Los Angeles, CA (US); and Hayko Jochen Wilhelm Riemenschneider, Zürich (CH)
Assigned to DISNEY ENTERPRISES, INC., Burbank, CA (US)
Filed by Disney Enterprises, Inc., Burbank, CA (US)
Filed on May 19, 2022, as Appl. No. 17/749,005.
Prior Publication US 2023/0377279 A1, Nov. 23, 2023
Int. Cl. G06T 19/00 (2011.01)
CPC G06T 19/006 (2013.01) 22 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
obtaining an indication of at least one virtual object available for placing within a real-world environment as part of an augmented reality (AR) simulation or a mixed reality (MR) simulation;
generating a first representation of the real-world environment, based on a scan of the real-world environment with one or more sensors of a computing device, wherein the first representation includes a first three-dimensional (3D) mesh representing a geometry of the real-world environment;
generating at least one second representation of the real-world environment by computing an inverse of the first 3D mesh corresponding to the first representation of the real-world environment, wherein the at least one second representation comprises a second 3D mesh of at least one empty space in the real-world environment;
determining a match between one or more attributes of the at least one virtual object and one or more additional attributes of the at least one empty space within the real-world environment, based at least in part on evaluating the at least one virtual object and the at least one second representation of the real-world environment with one or more machine learning models; and
rendering the at least one virtual object at a position on a display of the computing device, based on the match, the position on the display being associated with the at least one empty space within the real-world environment.