US 12,450,705 B2
Altering a facial identity in a video stream
Oran Gafni, Ramat Gan (IL); and Lior Wolf, Herzliya (IL)
Assigned to Meta Platforms, Inc., Menlo Park, CA (US)
Filed by Meta Platforms, Inc., Menlo Park, CA (US)
Filed on Dec. 18, 2020, as Appl. No. 17/127,506.
Prior Publication US 2022/0198617 A1, Jun. 23, 2022
Int. Cl. G06T 5/75 (2024.01); G06N 20/00 (2019.01); G06T 5/70 (2024.01); G06V 40/16 (2022.01)
CPC G06T 5/75 (2024.01) [G06N 20/00 (2019.01); G06T 5/70 (2024.01); G06V 40/172 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
generating, based on an image of a person, a first identity encoding representing a first facial identity of the person;
generating a second identity encoding representing a second facial identity different from the first facial identity of the person by processing the first identity encoding with a first facial-identity altering machine-learning model comprising one or more fully connected layers and training data to facilitate generating the second identity encoding, wherein the training data comprises (i) pairs of original face images and corresponding altered face images, and (ii) pairs of images of a different first person and a second person;
generating a source encoding by using an encoder to process a source image of the person comprising an expression;
generating an intermediate image by using a decoder to process the source encoding and the second identity encoding, the intermediate image comprising a face comprising the second facial identity and the expression of the person in the source image; and
generating an output image by blending the source image with facial features of the face in the intermediate image.