US 12,462,506 B2
3D models for augmented reality (AR)
Marwan Aljubeh, London (GB); Gregory James Bakker, Clapham (GB); Eric Nersesian, Summit, NJ (US); Supannee Tanathong, London (GB); and Yanli Zhao, London (GB)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Dec. 6, 2022, as Appl. No. 18/062,393.
Claims priority of provisional application 63/368,600, filed on Jul. 15, 2022.
Claims priority of provisional application 63/286,433, filed on Dec. 6, 2021.
Prior Publication US 2023/0177788 A1, Jun. 8, 2023
Int. Cl. G06T 19/20 (2011.01); G06T 7/579 (2017.01); G06T 7/70 (2017.01); G06T 19/00 (2011.01); G06F 3/0482 (2013.01)
CPC G06T 19/20 (2013.01) [G06T 7/579 (2017.01); G06T 7/70 (2017.01); G06T 19/006 (2013.01); G06F 3/0482 (2013.01); G06T 2200/08 (2013.01); G06T 2200/24 (2013.01); G06T 2219/2004 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A method for creating a three-dimensional (3D) model of a reference surface of a reference object, the method comprising:
capturing, using a capture device, a plurality of data points on the reference surface of the reference object;
determining a position and an orientation of the capture device related to the capture of the plurality of data points;
creating a 3D data representation of the reference surface of the reference object based on the plurality of data points captured by the capture device;
creating a location tracking data representation of the reference surface of the reference object based on the plurality of data points on the reference surface of the reference object and the position and the orientation of the capture device;
creating the 3D model of the reference surface of the reference object based on the 3D data representation and the location tracking data representation of the reference surface of the reference object; and
making the 3D model of the reference surface available to users who are physically located at a geographic location of the reference surface of the reference object,
wherein the creating the location tracking data representation of the reference surface comprises:
creating a frame, the frame corresponding to the position and the orientation of the capture device;
associating the frame with a set of data points of the plurality of data points;
creating the location tracking data representation based on the frame and the associated set of data points; and
aligning the location tracking data representation with the 3D data representation by performing an adjustment on the frame, the performing of the adjustment comprising:
adjusting the position of the frame according to an original position of the capture device; and
adjusting the orientation of the frame according to gravitational direction information of the capture device.