US 11,922,562 B2
Methods and systems for rendering view-dependent images using 2D images
Gordon Wetzstein, Fremont, CA (US); Andrew Jones, Fremont, CA (US); Petr Kellnhofer, Fremont, CA (US); Lars Jebe, Fremont, CA (US); Ryan Spicer, Fremont, CA (US); and Kari Pulli, Fremont, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Dec. 14, 2021, as Appl. No. 17/644,291.
Claims priority of provisional application 63/125,288, filed on Dec. 14, 2020.
Prior Publication US 2022/0189104 A1, Jun. 16, 2022
Int. Cl. G06T 15/20 (2011.01); G06F 3/01 (2006.01); G06N 3/048 (2023.01); G06T 7/55 (2017.01); G06T 17/20 (2006.01)
CPC G06T 15/20 (2013.01) [G06F 3/012 (2013.01); G06N 3/048 (2023.01); G06T 7/55 (2017.01); G06T 17/20 (2013.01); G06T 2207/20084 (2013.01)] 24 Claims
OG exemplary drawing
 
1. A method, comprising:
modeling, using image data, a three-dimensional (3D) shape of an object by obtaining a zero-level set of a signed distance function using a shape renderer of a rendering engine;
modeling an appearance of the object by minimizing an image reconstruction error based upon the image data capturing the 3D shape of the object using an appearance renderer of the rendering engine;
combining the 3D shape and the appearance of the object to generate a neural model of the object;
converting the neural model into a triangular mesh representing the object using the rendering engine; and
rendering at least one image using the triangular mesh and using the rendering engine.