US 11,922,591 B2
Rendering depth-based three-dimensional model with integrated image frames
Michael Ben Fleischman, Los Angeles, CA (US); Jeevan James Kalanithi, San Francisco, CA (US); Gabriel Hein, Albany, CA (US); and Elliott St. George Wilson Kember, San Francisco, CA (US)
Assigned to OPEN SPACE LABS, INC., San Francisco, CA (US)
Filed by Open Space Labs, Inc., San Francisco, CA (US)
Filed on Feb. 14, 2023, as Appl. No. 18/168,855.
Application 18/168,855 is a continuation of application No. 17/839,492, filed on Jun. 14, 2022, granted, now 11,610,379.
Application 17/839,492 is a continuation of application No. 17/367,204, filed on Jul. 2, 2021, granted, now 11,393,179, issued on Jul. 19, 2022.
Claims priority of provisional application 63/165,682, filed on Mar. 24, 2021.
Claims priority of provisional application 63/090,095, filed on Oct. 9, 2020.
Prior Publication US 2023/0196696 A1, Jun. 22, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 19/00 (2011.01); G01S 17/86 (2020.01); G01S 17/89 (2020.01); G06F 3/04815 (2022.01); G06F 3/04842 (2022.01); G06F 3/04845 (2022.01); G06T 17/00 (2006.01)
CPC G06T 19/006 (2013.01) [G01S 17/86 (2020.01); G01S 17/89 (2013.01); G06F 3/04815 (2013.01); G06F 3/04842 (2013.01); G06F 3/04845 (2013.01); G06T 17/00 (2013.01); G06F 2203/04806 (2013.01); G06T 2200/24 (2013.01); G06T 2219/004 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving image frames collected by a mobile device as the mobile device is moved through an environment;
generating a 3D model representing the environment based on the received image frames;
aligning the image frames with the 3D model; and
generating an interface displaying 1) a portion of the 3D model, 2) an image frame corresponding to a selected object within the 3D model, and 3) including a representation of an angle of capture of the image frame by the mobile device.