US 12,236,534 B1
Projecting existing user-generated content into an immersive view
Charles Goran, Lafayette, CO (US); Ilies Ghanzouri, Seattle, WA (US); Cardin Everett Moffett, Boulder, CO (US); Julien Benjamin Brette, Santa Clara, CA (US); Santiago David Lopez Lopez, Seva (ES); Marcos Seefelder de Assis Araujo, London (GB); and Daniel Joseph Filip, San Jose, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Feb. 16, 2024, as Appl. No. 18/444,013.
Int. Cl. G06T 19/00 (2011.01); G01C 21/36 (2006.01)
CPC G06T 19/003 (2013.01) [G01C 21/3638 (2013.01); G01C 21/3682 (2013.01); G06T 2200/24 (2013.01); G06T 2219/004 (2013.01); G06T 2219/024 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
obtaining a three-dimensional model representing a geographic location, wherein the three-dimensional model is generated by a machine-learned model based on a series of two-dimensional images of the geographic location that have been previously captured by a camera following one or more paths through the geographic location;
accessing user-generated media content associated with the geographic location;
receiving path information representing at least a portion of a path through the three-dimensional model representing the geographic location, wherein the path information is generated based on a path of the camera as it was previously moved through the geographic location to capture ordered series of two-dimensional images of the location for use in generating the three-dimensional model;
selecting one or more pieces of user-generated media content based, at least in part, on the path information;
modifying the three-dimensional model representing the geographic location to include the one or more pieces of user-generated media content based on the path information and a portion of the three-dimensional model to be displayed to a user, wherein the pieces of user-generated media content are presented within one or more visual pop-outs in the three-dimensional model; and
providing the three-dimensional model representing the geographic location for display to a user.