CPC G06T 19/20 (2013.01) [G06T 15/005 (2013.01); G06T 15/04 (2013.01); G06T 15/506 (2013.01); G06V 10/95 (2022.01); G06T 2219/2012 (2013.01); G06T 2219/2021 (2013.01)] | 20 Claims |
1. A computer-implemented method utilizing at least one processing device to perform operations including:
receiving a pose associated with an object in image content;
generating a plurality of three-dimensional (3D) proxy geometries of the object, the plurality of 3D proxy geometries being based on a shape of the object;
generating, based on the plurality of 3D proxy geometries, a plurality of neural textures of the object, each of the plurality of neural textures defining a plurality of different shapes and appearances representing the object, the plurality of neural textures being configured to reconstruct a hidden portion of the object captured in the image content;
providing the plurality of neural textures to a neural renderer, the plurality of neural textures being provided in a stacked formation, the hidden portion being reconstructed based on the stacked formation of the plurality of neural textures;
generating, by the neural renderer, transparent layers of the object and surfaces behind the transparent layers of the object based on the plurality of neural textures;
receiving, from the neural renderer and based on the plurality of neural textures, a color image and an alpha mask representing an opacity of at least a portion of the object; and
generating a composite image based on the pose, the color image, and the alpha mask.
|