US 12,444,139 B2
Automated generation and presentation of visual data enhancements on camera view images captured in a building
Manjunath Narayana, Chino Hills, CA (US); Eric M. Penner, Centennial, CO (US); Ivaylo Boyadzhiev, Seattle, WA (US); and Sing Bing Kang, Redmond, WA (US)
Assigned to MFTB Holdco, Inc., Seattle, WA (US)
Filed by MFTB Holdco, Inc., Seattle, WA (US)
Filed on Sep. 22, 2022, as Appl. No. 17/950,865.
Prior Publication US 2024/0104851 A1, Mar. 28, 2024
Int. Cl. G06T 19/00 (2011.01); G06F 3/04842 (2022.01); G06F 16/587 (2019.01); G06V 20/20 (2022.01)
CPC G06T 19/003 (2013.01) [G06F 3/04842 (2013.01); G06F 16/587 (2019.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01)] 30 Claims
OG exemplary drawing
 
1. A system comprising:
one or more hardware processors of one or more computing devices; and
one or more memories with stored instructions that, when executed by at least one of the one or more hardware processors, cause at least one of the one or more computing devices to perform automated operations including at least:
obtaining data for a building with multiple rooms, including information about multiple objects at the building, and including information about respective positions at the building associated with the multiple objects, wherein the multiple objects in the building include at least appliances, fixtures, and structural elements, and wherein the multiple objects in the building further have colors and types of surface materials;
receiving a target image showing a current view from a camera of a mobile device at the building;
determining a subset of the building visible in the target image;
selecting one or more objects of the multiple objects that have respective positions in the subset of the building;
generating visual enhancement data that includes, for each of the selected objects, at least one visual indicator for that selected object for presentation at the respective position of that selected object, and information indicating the determined one or more utility values associated with that selected object; and
providing information to the mobile device, including providing the visual enhancement data for presentation on the mobile device overlaid on the current view from the camera, wherein the visual enhancement data for presentation includes at least one of a color or a type of surface material for one of the selected objects.