US 12,462,483 B2
Automated localization using beacon transmitter devices of data acquired in buildings
Sean P. Cier, Ravensdale, WA (US); Sing Bing Kang, Redmond, WA (US); and Chris North, Seattle, WA (US)
Assigned to MFTB Holdco, Inc., Seattle, WA (US)
Filed by MFTB Holdco, Inc., Seattle, WA (US)
Filed on Jan. 5, 2023, as Appl. No. 18/093,780.
Prior Publication US 2024/0233260 A1, Jul. 11, 2024
Int. Cl. G06T 17/05 (2011.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01)
CPC G06T 17/05 (2013.01) [G06T 7/50 (2017.01); G06T 7/70 (2017.01)] 27 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
obtaining, by one or more computing devices that include an image acquisition device having a camera and a beacon signal receiver and one or more hardware processors, information about a plurality of wireless beacon transmitter devices in multiple rooms of a house that includes, for each of the wireless beacon transmitter devices, an associated identifier transmitted by that wireless beacon transmitter device and a respective location of that wireless beacon transmitter device in one of the multiple rooms;
acquiring, by the image acquisition device, multiple images and additional data at multiple acquisition locations in the multiple rooms of the house, the additional data including, for each of the multiple acquisition locations, one or more received wireless transmissions from one or more of the plurality of wireless beacon transmitter devices that include at least the identifier of each of the one or more wireless beacon transmitter devices; and
determining, by the image acquisition device and for each of the multiple acquisition locations, a position in the house of that acquisition location, including combining, for each of the one or more wireless beacon transmitter devices from which the wireless transmissions are received at that acquisition location, the respective location in the house of that wireless beacon transmitter device with determined information from the one or more wireless transmissions received at that acquisition location about at least one of direction or distance between that acquisition location and that wireless beacon transmitter device;
generating, by the image acquisition device and based at least in part on the determined positions in the house of the multiple acquisition locations, a floor plan for the house, including determining multiple room shapes that are based on analysis of visual data of the multiple images and that include a respective room shape of each of the multiple rooms with planar surfaces to represent locations of walls and a floor and a ceiling of that room, and positioning the determined multiple room shapes relative to each other on the floor plan;
generating, by the image acquisition device and based at least in part on the generated floor plan, feedback regarding acquisition of one or more additional images in one or more additional areas of the house, the feedback including information about at least one of quality or completeness for at least one of the multiple images;
presenting, by the image acquisition device, the generated floor plan and the generated feedback;
acquiring, by the image acquisition device and after the presenting, the one or more additional images in the one or more additional areas of the house; and
generating, by the one or more computing devices, a further floor plan for the house based at least in part on adding information for the house to the floor plan from the acquired one or more additional images.