US 12,488,524 B2
Synthesizing sequences of 3D geometries for movement-based performance
Derek Edward Bradley, Zurich (CH); Prashanth Chandran, Zurich (CH); Paulo Fabiano Urnau Gotardo, Zurich (CH); and Gaspard Zoss, Zurich (CH)
Assigned to Disney Enterprises, INC., Burbank, CA (US); and ETH Zürich (Eidgenössische Technische Hochschule Zürich), Zürich (CH)
Filed by DISNEY ENTERPRISES, INC., Burbank, CA (US); and ETH Zürich (Eidgenössische Technische Hochschule Zürich), Zürich (CH)
Filed on Nov. 15, 2021, as Appl. No. 17/526,608.
Prior Publication US 2023/0154089 A1, May 18, 2023
Int. Cl. G06T 13/40 (2011.01); G06N 3/045 (2023.01); G06N 3/088 (2023.01); G06T 3/00 (2024.01); G06T 9/00 (2006.01)
CPC G06T 13/40 (2013.01) [G06N 3/045 (2023.01); G06N 3/088 (2013.01); G06T 3/00 (2013.01); G06T 9/002 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for generating a sequence of three-dimensional (3D) geometries, the computer-implemented method comprising:
converting, via an encoder neural network, one or more input 3D geometries corresponding to one or more frames within an animation into one or more latent vectors;
combining (i) a capture code that represents one or more attributes of the sequence of 3D geometries with (ii) a plurality of position encodings that represent a plurality of time steps within the animation to produce a plurality of position-encoded representations of the capture code;
generating, via a decoder neural network, the sequence of 3D geometries based on input that includes (i) the one or more latent vectors and (ii) the plurality of position-encoded representations of the capture code, wherein each 3D geometry included in the sequence of 3D geometries corresponds to (i) a different time step included in the plurality of time steps and (ii) a different frame included in a sequence of frames within the animation; and
causing output related to the animation to be generated based on the sequence of 3D geometries.