US 11,908,077 B2
Generating and validating a virtual 3D representation of a real-world structure
Ajay Mishra, Palo Alto, CA (US); Manish Upendran, San Francisco, CA (US); A. J. Altman, San Francisco, CA (US); and William Castillo, San Carlos, CA (US)
Assigned to HOVER Inc., San Francisco, CA (US)
Filed by HOVER Inc., San Francisco, CA (US)
Filed on Jan. 27, 2023, as Appl. No. 18/160,706.
Application 18/160,706 is a continuation of application No. 17/379,254, filed on Jul. 19, 2021, granted, now 11,663,776.
Application 17/379,254 is a continuation of application No. 16/220,900, filed on Dec. 14, 2018, granted, now 11,100,704, issued on Aug. 24, 2021.
Prior Publication US 2023/0169724 A1, Jun. 1, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 17/05 (2011.01); G06T 7/55 (2017.01); G06T 17/00 (2006.01); G06T 7/00 (2017.01); G06F 30/13 (2020.01); G06T 15/20 (2011.01)
CPC G06T 17/05 (2013.01) [G06F 30/13 (2020.01); G06T 7/55 (2017.01); G06T 7/97 (2017.01); G06T 17/00 (2013.01); G06T 15/205 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method for generating a 3D model of a real-world structure, the method comprising:
for each image of a plurality of images of the real-world structure, identifying one or more landmarks in the image;
providing metadata for the one or more identified landmarks of each image, the metadata for each landmark of the one or more identified landmarks specifying a shape of the landmark and a label for the landmark;
correlating one or more of the identified landmarks in each image of the plurality of images with one or more identified landmarks in other images of the plurality of images;
selecting, from a plurality of structure categories, one or more structure categories applicable to the real-world structure, wherein each structure category comprises structure data that defines an overall peripheral shape of structures belonging to the structure category, wherein selecting one or more structure categories applicable to the real-world structure is based, at least in part, on one or more of the identified landmarks; and
generating the 3D model of the real-world structure based, at least in part, on:
the identified landmarks,
the correlations between the identified landmarks in different ones of the plurality of images; and
geometrical constraints for the identified landmarks.