CPC G06T 15/04 (2013.01) [G06N 3/045 (2023.01); G06N 3/08 (2013.01); G06T 15/20 (2013.01); G06T 19/20 (2013.01)] | 18 Claims |
1. A computer-implemented method comprising:
obtaining a plurality of images of a scene depicting at least one object;
determining a volume density of the scene using a scene geometry network to generate a 3D geometric representation of the object;
mapping 3D points of the scene to a 2D texture space using a texture mapping network, wherein the texture mapping network is trained on a cycle loss using an inverse texture mapping network that maps back from the 2D texture space to 3D points to train the texture mapping network and the inverse texture mapping network to enforce a cycle mapping between the 2D texture space and points on a surface of the scene; and
determining radiance values for each 2D point in the 2D texture space from a plurality of viewpoints using a texture network to generate a 3D appearance representation of the object.
|