US 12,190,581 B2
Automated usability assessment of buildings using visual data of captured in-room images
Viktoriya Stoeva, Phoenix, AZ (US); Sing Bing Kang, Redmond, WA (US); Naji Khosravan, Seattle, WA (US); and Lambert E. Wixson, Bellevue, WA (US)
Assigned to MFTB Holdco, Inc., Seattle, WA (US)
Filed by MFTB Holdco, Inc., Seattle, WA (US)
Filed on Sep. 11, 2023, as Appl. No. 18/244,298.
Application 18/244,298 is a continuation of application No. 17/185,793, filed on Feb. 25, 2021, granted, now 11,790,648.
Prior Publication US 2023/0419662 A1, Dec. 28, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/20 (2022.01); G06N 3/08 (2023.01); G06T 7/55 (2017.01); G06T 19/00 (2011.01); G06F 16/90 (2019.01)
CPC G06V 20/20 (2022.01) [G06N 3/08 (2013.01); G06T 7/55 (2017.01); G06T 19/006 (2013.01); G06F 16/90 (2019.01); G06T 2210/04 (2013.01); G06T 2210/12 (2013.01); G06T 2210/61 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
obtaining, by one or more computing systems, one or more panorama images captured in a room of a house and having visual data that in combination provides 360 degrees of horizontal visual data of the room;
determining, by the one or more computing systems, and for each of multiple objects installed in the room, one or more target attributes of that object for which to capture additional data, including analyzing the visual data of the one or more panorama images to identify the multiple objects and to determine locations of the multiple objects in the room and to determine that the visual data of the one or more panorama images lacks details sufficient to satisfy a defined threshold about the one or more target attributes of each of the multiple objects;
providing, by the one or more computing systems, instructions about capturing the additional data about the one or more target attributes of each of the multiple objects and that include information about the determined locations of the multiple objects, wherein the capturing of the additional data includes obtaining additional perspective images of one or more specified types of the multiple objects;
determining, by the one or more computing systems, an assessment of a current usability of the room for an indicated purpose, including assessing current contributions of the multiple objects to the current usability of the room based at least in part on information from the additional data about the one or more target attributes of each of the multiple objects, and including combining information about the assessed current contributions of the multiple objects; and
displaying, by the one or more computing systems, information about the determined assessment of the current usability of the room along with additional visual information about the room.