US 12,266,011 B1
User interface for image-based rendering of virtual tours
David Eraker, Waldron, WA (US); Aravind Kalaiah, San Jose, CA (US); and Robert McGarty, Seattle, WA (US)
Assigned to Appliance Computing III, Inc., Seattle, WA (US)
Filed by Appliance Computing III, Inc., Seattle, WA (US)
Filed on Mar. 1, 2024, as Appl. No. 18/592,844.
Application 18/592,844 is a continuation of application No. 18/111,563, filed on Feb. 18, 2023, granted, now 11,948,186.
Application 18/111,563 is a continuation of application No. 16/744,169, filed on Jan. 15, 2020, granted, now 11,610,256, issued on Mar. 21, 2023.
Application 16/744,169 is a continuation of application No. 16/363,807, filed on Mar. 25, 2019, abandoned.
Application 16/363,807 is a continuation of application No. 14/525,052, filed on Oct. 27, 2014, granted, now 10,242,400, issued on Mar. 26, 2019.
Claims priority of provisional application 61/895,978, filed on Oct. 25, 2013.
This patent is subject to a terminal disclaimer.
Int. Cl. G06Q 30/00 (2023.01); G06F 3/04815 (2022.01); G06F 3/04842 (2022.01); G06F 16/951 (2019.01); G06Q 30/0601 (2023.01); G06Q 50/16 (2012.01); G06T 11/60 (2006.01); G06T 17/00 (2006.01); G06T 19/00 (2011.01); G09G 5/14 (2006.01)
CPC G06Q 30/0643 (2013.01) [G06F 3/04815 (2013.01); G06F 3/04842 (2013.01); G06F 16/951 (2019.01); G06Q 30/0623 (2013.01); G06Q 50/16 (2013.01); G06T 11/60 (2013.01); G06T 17/00 (2013.01); G06T 19/003 (2013.01); G09G 5/14 (2013.01); G06T 2210/04 (2013.01); G06T 2219/028 (2013.01); G09G 2340/12 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-readable memory medium containing program commands for controlling a computer processor, when executed in a computer system, to facilitate a virtual tour of a real property using image-based rendering, by performing a method comprising:
defining a plurality of spatial boundaries of a plurality of spaces of a selected real property, each spatial boundary delineating a volume of one or more of the plurality of spaces of the selected real property, at least one of the plurality of spatial boundaries identifying an area of the selected real property, and at least one of the plurality of spatial boundaries defining a space located within the identified area of the selected real property;
receiving annotated images that delineate one or more floors, walls, or ceilings;
receiving annotated images that delineate one or more windows, doorways, hallways, stairs, or other structural features;
receiving annotated images with one or more room labels, floor level labels, and/or outdoor area labels associated with the spatial data boundaries;
based upon the received annotated images, automatically identifying, in a plurality of captured images or panoramas, one or more floors, walls, ceilings, windows, doorways, hallways, stairs, or other structural features and one or more rooms, floor levels, indoor areas, and outdoor areas;
automatically generating a labeled floor plan from the automatically identified one or more floors, walls, ceilings, windows, doorways, hallways, stairs, or other structural features and the one or more rooms, floor levels, indoor areas, and outdoor areas;
causing the computer system to render a virtual model of the selected real property from a viewpoint in the selected real property, the virtual model comprising a plurality of views of one or more of the plurality of spaces of the selected real property and geometric information, each of the plurality of views comprising images, panoramas, or synthesized views and associated with a corresponding spatial boundary indicative of a capture location within the selected real property;
causing a device to display the generated floor plan; and
receiving an indication of a location within the real property and causing the device to display at least a portion of the rendered virtual model of the selected real property.