US 12,266,166 B2
Automated spatial indexing of images to video
Michael Ben Fleischman, San Francisco, CA (US); Philip DeCamp, Boulder, CO (US); and Jeevan James Kalanithi, San Francisco, CA (US)
Assigned to Open Space Labs, Inc., San Francisco, CA (US)
Filed by Open Space Labs, Inc., San Francisco, CA (US)
Filed on Apr. 24, 2024, as Appl. No. 18/645,235.
Application 18/645,235 is a continuation of application No. 18/188,300, filed on Mar. 22, 2023, granted, now 11,995,885.
Application 18/188,300 is a continuation of application No. 17/501,115, filed on Oct. 14, 2021, granted, now 11,638,001, issued on Apr. 25, 2023.
Application 17/501,115 is a continuation of application No. 17/151,004, filed on Jan. 15, 2021, granted, now 11,178,386, issued on Nov. 16, 2021.
Application 17/151,004 is a continuation of application No. 16/680,318, filed on Nov. 11, 2019, granted, now 10,944,959, issued on Mar. 9, 2021.
Claims priority of provisional application 62/759,945, filed on Nov. 12, 2018.
Prior Publication US 2024/0273893 A1, Aug. 15, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/10 (2022.01); G06T 17/00 (2006.01); G06T 19/00 (2011.01); G06V 10/70 (2022.01); G06V 20/20 (2022.01); G06V 20/40 (2022.01); G06V 20/52 (2022.01); G06V 20/64 (2022.01); H04N 13/279 (2018.01); H04N 13/282 (2018.01); H04N 23/62 (2023.01); H04N 23/63 (2023.01); H04N 23/661 (2023.01)
CPC G06V 20/10 (2022.01) [G06T 17/00 (2013.01); G06T 19/003 (2013.01); G06V 10/70 (2022.01); G06V 20/20 (2022.01); G06V 20/52 (2022.01); G06V 20/64 (2022.01); H04N 13/279 (2018.05); H04N 13/282 (2018.05); H04N 23/62 (2023.01); H04N 23/631 (2023.01); H04N 23/661 (2023.01); G06T 2200/24 (2013.01); G06T 2210/04 (2013.01); G06T 2219/004 (2013.01); G06T 2219/024 (2013.01); G06V 20/44 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
generating and displaying a three-dimensional rendering of an environment based at least in part on video captured by an image capture system as the image capture system moves through the environment;
determining a location associated with a content annotation created within the environment based on a comparison of a first timestamp captured by a content annotation system that creates the content annotation to a second timestamp captured by the image capture system; and
modifying the displayed three-dimensional rendering of the environment to include the content annotation at the location within the three-dimensional rendering of the environment.