US 12,205,213 B2
Synthesizing sequences of images for movement-based performance
Derek Edward Bradley, Zurich (CH); Prashanth Chandran, Zurich (CH); Paulo Fabiano Urnau Gotardo, Zurich (CH); and Gaspard Zoss, Zurich (CH)
Assigned to Disney Enterprises, INC., Burbank, CA (US); and ETH Zürich (Eidgenössische Technische Hochschule Zürich), Zürich (CH)
Filed by DISNEY ENTERPRISES, INC., Burbank, CA (US); and ETH Zürich (Eidgenössische Technische Hochschule Zürich), Zürich (CH)
Filed on Nov. 15, 2021, as Appl. No. 17/526,647.
Prior Publication US 2023/0154090 A1, May 18, 2023
Int. Cl. G06T 13/40 (2011.01); G06N 3/08 (2023.01); G06T 7/215 (2017.01); G06T 13/80 (2011.01); G06T 15/04 (2011.01); G06T 17/20 (2006.01); G06T 19/20 (2011.01)
CPC G06T 13/40 (2013.01) [G06N 3/08 (2013.01); G06T 7/215 (2017.01); G06T 13/80 (2013.01); G06T 15/04 (2013.01); G06T 17/20 (2013.01); G06T 19/20 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30201 (2013.01); G06T 2219/2021 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for rendering an input geometry, the computer-implemented method comprising:
generating a first segmentation mask for a first input three-dimensional (3D) geometry and a first plurality of texture maps associated with a plurality of portions of the first input 3D geometry;
generating, via execution of a plurality of generator blocks included in one or more neural networks, a first plurality of neural textures for the plurality of portions of the first input 3D geometry, wherein each generator block included in the plurality of generator blocks generates a neural texture for a different portion included in the plurality of portions of the first input 3D geometry, wherein portions of the first input 3D geometry corresponding to different generator blocks included in the plurality of generator blocks are non-overlapping; and
rendering a first image corresponding to the first input 3D geometry based on the first segmentation mask, the first plurality of texture maps, and the first plurality of neural textures.