US 11,704,853 B2
Techniques for feature-based neural rendering
Dominik Tobias Borer, Zurich (CH); Martin Guay, Zurich (CH); Jakob Joachim Buhmann, Zurich (CH); and Robert Walker Sumner, Zurich (CH)
Assigned to DISNEY ENTERPRISES, INC., Burbank, CA (US); and ETH ZÜRICH (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH), Zürich (CH)
Filed by DISNEY ENTERPRISES, INC., Burbank, CA (US)
Filed on Jul. 15, 2019, as Appl. No. 16/511,961.
Prior Publication US 2021/0019928 A1, Jan. 21, 2021
Int. Cl. G06T 13/40 (2011.01); G06N 20/00 (2019.01); G06F 17/15 (2006.01); G06N 3/04 (2023.01); G06T 19/00 (2011.01)
CPC G06T 13/40 (2013.01) [G06F 17/15 (2013.01); G06N 3/04 (2013.01); G06N 20/00 (2019.01); G06T 19/006 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computer-implemented method for rendering an image that includes at least one character, the method comprising:
determining, by one or more computing devices, pose information for a first character based on a control signal; and
inputting the pose information and three-dimensional (3D) information associated with a 3D model of the first character into a trained machine learning model, wherein the trained machine learning model generates a rendered image of the first character based on the pose information and the 3D information, and wherein the trained machine learning model is trained based on a perceptual loss between images generated by the trained machine learning model and associated rendered images included in a set of training data.