US 12,347,048 B2
Matching content to a spatial 3D environment
Denys Bastov, Palo Alto, CA (US); Victor Ng-Thow-Hing, Los Altos, CA (US); Benjamin Zaaron Reinhardt, San Francisco, CA (US); Leonid Zolotarev, Weston, FL (US); Yannick Pellet, Plantation, FL (US); Aleksei Marchenko, Sunnyvale, CA (US); Brian Everett Meaney, Parkland, FL (US); Marc Coleman Shelton, Fort Lauderdale, FL (US); Megan Ann Geiman, Fort Lauderdale, FL (US); John A. Gotcher, Prosper, TX (US); Matthew Schon Bogue, McKinney, TX (US); Shivakumar Balasubramanyam, Rancho Santa Fe, CA (US); Jeffrey Edward Ruediger, McKinney, TX (US); and David Charles Lundmark, Los Altos, CA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by MAGIC LEAP, INC.
Filed on Nov. 29, 2023, as Appl. No. 18/523,763.
Application 18/523,763 is a continuation of application No. 17/663,792, filed on May 17, 2022, granted, now 11,875,466.
Application 17/663,792 is a continuation of application No. 17/142,210, filed on Jan. 5, 2021, granted, now 11,373,376, issued on Jun. 28, 2022.
Application 17/142,210 is a continuation of application No. 15/968,673, filed on May 1, 2018, granted, now 10,930,076, issued on Feb. 23, 2021.
Claims priority of provisional application 62/644,377, filed on Mar. 16, 2018.
Claims priority of provisional application 62/610,108, filed on Dec. 22, 2017.
Claims priority of provisional application 62/492,292, filed on May 1, 2017.
Prior Publication US 2024/0096038 A1, Mar. 21, 2024
Int. Cl. G06T 19/00 (2011.01); G06F 3/01 (2006.01); G06F 3/04815 (2022.01); G06T 19/20 (2011.01); H04N 21/254 (2011.01); H04N 21/431 (2011.01); H04N 21/81 (2011.01)
CPC G06T 19/006 (2013.01) [G06F 3/011 (2013.01); G06F 3/04815 (2013.01); G06T 19/20 (2013.01); G06T 2207/10028 (2013.01); H04N 21/2542 (2013.01); H04N 21/4312 (2013.01); H04N 21/816 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A computer-implemented method for presenting virtual content within a physical environment to a user, comprising:
receiving, at an extended reality system, virtual content from a content provider, the virtual content comprising a content element and a formatting tag associated with the content element, the formatting tag defining an attribute of a surface on which the content element is to be placed;
identifying content element within the received content;
extracting the formatting tag from the identified content element;
identifying a surface within the physical environment having the attribute of the surface defined by the formatting tag;
presenting a mixed reality landscape to the user, such that the identified content element is placed on the identified surface; and
identifying a plurality of surface options in the physical environment having the attribute of the surface defined by the formatting tag;
placing the identified content element on each of the identified plurality of surface options;
providing the user with an option to select one of the identified plurality of surface options; and
selecting the one of the identified plurality of surface options as the identified surface on which the identified content element is placed.