US 12,444,140 B2
Virtual walkthrough experience generation based on neural radiance field model renderings
Carlos Montero, Jr., Brier, WA (US); Marcos Seefelder de Assis Araujo, London (GB); Cardin Everett Moffett, Denver, CO (US); and Charles Goran, Lafayette, CO (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Nov. 22, 2023, as Appl. No. 18/517,455.
Prior Publication US 2025/0166311 A1, May 22, 2025
Int. Cl. G06T 19/00 (2011.01); G06F 16/787 (2019.01); G06T 7/10 (2017.01); H04N 13/354 (2018.01)
CPC G06T 19/003 (2013.01) [G06F 16/787 (2019.01); G06T 7/10 (2017.01); H04N 13/354 (2018.05)] 22 Claims
OG exemplary drawing
 
1. A computer-implemented method for generating a virtual walkthrough video, the method comprising:
obtaining, by a computing system comprising one or more processors, one or more neural radiance field models associated with an environment, wherein the one or more neural radiance field models were trained to generate view renderings of the environment, wherein the environment is associated with a geographic location;
processing, by the computing system, a plurality of positions with the one or more neural radiance field models to generate a plurality of view synthesis renderings of the environment, wherein the plurality of positions are associated with a plurality of locations within the environment, and wherein the plurality of view synthesis renderings are descriptive of the environment from the plurality of positions;
generating, by the computing system, a virtual walkthrough video based on the plurality of view synthesis renderings of the environment, wherein the virtual walkthrough video is descriptive of a sequence of views of the environment, wherein generating, by the computing system, the virtual walkthrough video based on the plurality of view synthesis renderings of the environment comprises:
generating, by the computing system, a first rendering video based on rendering the sequence of views of the environment in a first direction;
generating, by the computing system, a second rendering video based on rendering the sequence of views of the environment in a second direction; and
generating, by the computing system, the virtual walkthrough video by combining the first rendering video and the second rendering video; and
storing, by the computing system, the virtual walkthrough video in a database, wherein storing the virtual walkthrough video comprises indexing the virtual walkthrough video with the geographic location associated with the environment.