US 12,243,349 B2
Face reconstruction using a mesh convolution network
Derek Edward Bradley, Zurich (CH); Prashanth Chandran, Zurich (CH); Simone Foti, London (GB); Paulo Fabiano Urnau Gotardo, Zurich (CH); and Gaspard Zoss, Zurich (CH)
Assigned to Disney Enterprises, INC., Burbank, CA (US); and ETH Zürich (Eidgenössische Technische Hochschule Zürich), Zurich (CH)
Filed by DISNEY ENTERPRISES, INC., Burbank, CA (US); and ETH Zürich (Eidgenössische Technische Hochschule Zürich), Zürich (CH)
Filed on Mar. 17, 2022, as Appl. No. 17/697,774.
Claims priority of provisional application 63/162,204, filed on Mar. 17, 2021.
Prior Publication US 2022/0301348 A1, Sep. 22, 2022
Int. Cl. G06V 40/16 (2022.01); G06T 17/20 (2006.01); G06V 10/44 (2022.01)
CPC G06V 40/176 (2022.01) [G06T 17/20 (2013.01); G06V 40/166 (2022.01); G06V 40/172 (2022.01); G06V 10/454 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for performing reconstruction of a face, the computer-implemented method comprising:
generating an identity mesh based on an identity encoding that represents an identity associated with a face in one or more images;
generating an expression mesh based on an expression encoding that represents an expression associated with the face in the one or more images; and
generating, by a machine learning model, an output mesh of the face via an upsampling operation associated with at least one of the identity mesh or the expression mesh.