US 12,482,076 B2
Techniques for enhancing skin renders using neural network projection for rendering completion
Derek Edward Bradley, Zurich (CH); Prashanth Chandran, Zurich (CH); Paulo Fabiano Urnau Gotardo, Zurich (CH); Jeremy Riviere, Zurich (CH); Sebastian Valentin Winberg, Zurich (CH); and Gaspard Zoss, Zurich (CH)
Assigned to Disney Enterprises, INC., Burbank, CA (US); and ETH Zürich (Eidgenössische Technische Hochschule Zürich), Zürich (CH)
Filed by DISNEY ENTERPRISES, INC., Burbank, CA (US); and ETH Zürich (Eidgenössische Technische Hochschule Zürich), Zürich (CH)
Filed on Nov. 29, 2021, as Appl. No. 17/536,777.
Claims priority of provisional application 63/142,957, filed on Jan. 28, 2021.
Prior Publication US 2022/0237751 A1, Jul. 28, 2022
Int. Cl. G06N 3/045 (2023.01); G06N 3/047 (2023.01); G06N 3/048 (2023.01); G06N 3/08 (2023.01); G06T 5/60 (2024.01); G06T 5/77 (2024.01); G06T 7/11 (2017.01); G06T 11/00 (2006.01); G06T 11/60 (2006.01); G06T 13/40 (2011.01); G06T 15/00 (2011.01); G06T 15/50 (2011.01); G06V 10/82 (2022.01); G06V 40/16 (2022.01)
CPC G06T 5/77 (2024.01) [G06N 3/08 (2013.01); G06T 15/503 (2013.01); G06V 40/165 (2022.01); G06V 40/171 (2022.01); G06T 2207/30201 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for rendering a head portrait, the method comprising:
rendering a first set of images, wherein each image included in the first set of images comprises one or more skin regions of a face in each image and excludes non-skin regions of the face in each image, the non-skin regions of the face including background pixels associated with non-facial content;
determining a set of parameters based on one or more optimization operations, the first set of images, and a machine learning model;
generating a second set of images based on the set of parameters and the machine learning model, wherein each image included in the second set of images comprises one or more skin regions associated with the face and one or more non-skin regions, wherein the set of parameters constrain the one or more skin regions of each image included in the second set of images to resemble one or more skin regions of a corresponding image included in the first set of images, and wherein the set of parameters constrain the one or more non-skin regions of each image included in the second set of images to correspond to non-skin regions of other images included in the second set of images; and
blending each image included in the first set of images with a corresponding image included in the second set of images.