US 12,190,429 B2
Method and system for construction project management using photo imaging measurements
William Ernest Miller, Union City, NJ (US)
Filed by William Ernest Miller, Union City, NJ (US)
Filed on Feb. 24, 2021, as Appl. No. 17/183,704.
Application 17/183,704 is a continuation in part of application No. 16/742,094, filed on Jan. 14, 2020, abandoned.
Application 16/742,094 is a continuation of application No. 14/625,790, filed on Feb. 19, 2015, granted, now 10,540,801, issued on Jan. 21, 2020.
Claims priority of provisional application 61/942,162, filed on Feb. 20, 2014.
Prior Publication US 2021/0183128 A1, Jun. 17, 2021
Int. Cl. G06T 15/00 (2011.01); G06F 3/04815 (2022.01); G06F 16/50 (2019.01); G06F 16/53 (2019.01); G06F 16/56 (2019.01); G06F 16/58 (2019.01); G06F 21/36 (2013.01); G06Q 10/0631 (2023.01); G06Q 30/0601 (2023.01); G06T 11/60 (2006.01); G06T 17/20 (2006.01); G06V 20/20 (2022.01); H04L 9/40 (2022.01); H04N 1/00 (2006.01); H04N 13/275 (2018.01)
CPC G06T 15/005 (2013.01) [G06F 3/04815 (2013.01); G06F 16/50 (2019.01); G06F 16/53 (2019.01); G06F 16/56 (2019.01); G06F 16/58 (2019.01); G06F 21/36 (2013.01); G06Q 10/06313 (2013.01); G06Q 30/0621 (2013.01); G06Q 30/0643 (2013.01); G06T 11/60 (2013.01); G06T 17/20 (2013.01); G06V 20/20 (2022.01); H04L 9/40 (2022.05); G06T 2207/10004 (2013.01); G06T 2207/20221 (2013.01); H04N 1/00204 (2013.01); H04N 13/275 (2018.05); H04N 2201/0081 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method comprising:
collecting, at a server via a network, training data comprising images of rooms;
determining at the server design components via object recognition operations performed on the images, a set of design components in each of the rooms and at least one profile model applicable to each of the rooms;
collecting at the server via the network retailer information for a plurality of retail products available via one or more vendor ecommerce sites, wherein the retailer information is indexed by the server against a set of profile models and a set of design components, wherein each of the set of design components comprise a set of purchasable items;
collecting visual data of a room by taking at least one image via a camera of a mobile computing device and conveying the visual data over the network to the server:
calculating at the server dimensions of at least one aspect of the room
determining at the server one of the profile models applicable to the room and determine a plurality of project resource templates applicable to the room given the determined profile model, wherein each project resource template comprises a subset of design components specific to that template and the determined profile model, conveying project resource template information from the server to the mobile device over the network;
displaying via a user interface of the mobile device via a plurality of project resource templates consistent with the project resource template information;
selecting at the mobile device one of the project resource templates in response to a user input;
displaying at the mobile device a set of design components based on a selected project resource template and calculated dimensions of the at least one aspect of the room;
displaying at the mobile device, an augmented reality environment of the room, the augmented reality environment configured to show the room as the room would be if a user selected one of the set of design components were added to the room, wherein the augmented reality environment of the mobile device is configured to allow the user to engage with the selected design component to manipulate a location and orientation of the selected design component within the augmented reality environment, wherein manipulation of the location and orientation affects a placement of the selected design element, which affects associated purchasable items related to the selected design component as applied to the room per the manipulation;
generating at the server a cost estimate and a set of materials, comprising a subset of the purchasable items from the vendor ecommerce sites to complete a project with the selected design component given the manipulation; and
providing an online cart via the mobile device for purchasing the selected design component and the set of materials.