US 12,236,523 B2
Systems and methods for visualization of building structures
Brice Dubost, Newton, MA (US); Sizhu You, Auburndale, MA (US); and Rachel Z. Pytel, Newton, MA (US)
Assigned to CERTAINTEED LLC, Malvern, PA (US)
Filed by Certain Teed LLC, Malvern, PA (US)
Filed on Jul. 18, 2023, as Appl. No. 18/223,048.
Application 18/223,048 is a continuation of application No. 17/543,837, filed on Dec. 7, 2021, granted, now 11,704,866.
Application 17/543,837 is a continuation of application No. 16/540,835, filed on Aug. 14, 2019, granted, now 11,195,324, issued on Dec. 7, 2021.
Claims priority of provisional application 62/718,818, filed on Aug. 14, 2018.
Claims priority of provisional application 62/718,832, filed on Aug. 14, 2018.
Prior Publication US 2024/0119663 A1, Apr. 11, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 15/50 (2011.01); G06F 30/20 (2020.01); G06T 15/00 (2011.01); G06T 15/20 (2011.01)
CPC G06T 15/506 (2013.01) [G06F 30/20 (2020.01); G06T 15/005 (2013.01); G06T 15/20 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A system configured for integration of real and virtual images for visualization of building construction, the system comprising:
a computing system; and
a display device communicatively connected with the computing system,
wherein the computing system is configured to:
construct a virtual three-dimensional (3D) model of a building structure at a given location based on data descriptive of the building structure;
generate a rendered image of the building structure as viewed from a simulated viewing point corresponding to an actual viewing point of a camera device during acquisition of an image of the building structure, the rendered image further being based at least on the 3D model and image information associated with the acquired image and comprising data indicative of acquisitional circumstances of the acquired image; and
determine a masked portion of the acquired image occupied only by the building structure,
and wherein the display device is configured to:
generate a merged image of the acquired image and the rendered image in which the rendered image occupies the masked portion of the acquired image;
wherein generating the rendered image of the building structure as viewed from the simulated viewing point corresponding to the actual viewing point comprises:
determining a position and perspective of the camera device with respect to the building structure when the acquired image was acquired; and
generating the rendered image of the building structure as viewed from a rendering perspective that matches the determined position and perspective of the camera device with respect to the building structure,
wherein determining the position and perspective of the camera device with respect to the building structure comprises at least one of the following:
1) determining the position and perspective of the camera device based on the actual viewing point and the given location of the building structure;
2) determining an apparent size and shape on the acquired image of the building structure of an element having a known size and shape, and geometrically determining the position and perspective of the camera device such that the apparent size and shape of the element is reproduced from the known size and shape of the element as viewed from the geometrically determined position and perspective; or
3) determining the geographic location of the camera device when the acquired image was acquired.