US 11,861,936 B2
Face reenactment
Pavel Savchenkov, London (GB); Dmitry Matov, London (GB); Aleksandr Mashrabov, Los Angeles, CA (US); and Alexey Pchelnikov, London (GB)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Jul. 21, 2022, as Appl. No. 17/869,794.
Application 17/869,794 is a continuation of application No. 17/034,029, filed on Sep. 28, 2020, granted, now 11,410,457.
Application 17/034,029 is a continuation of application No. 16/251,436, filed on Jan. 18, 2019, granted, now 10,789,453, issued on Sep. 29, 2020.
Prior Publication US 2022/0358784 A1, Nov. 10, 2022
Int. Cl. G06V 40/16 (2022.01); G06N 3/04 (2023.01); G06Q 30/0251 (2023.01); G06T 11/00 (2006.01)
CPC G06V 40/161 (2022.01) [G06N 3/04 (2013.01); G06Q 30/0254 (2013.01); G06Q 30/0269 (2013.01); G06T 11/001 (2013.01); G06V 40/174 (2022.01); G06V 40/178 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method for face reenactment, the method comprising:
receiving, by a computing device, visual data including a visible portion of a source face;
determining, by the computing device and based on the visible portion of the source face, a first portion of source face parameters associated with a parametric face model, the first portion corresponding to the visible portion;
predicting, by the computing device and based partially on the visible portion of the source face, a second portion of the source face parameters, the second portion corresponding to the rest of the source face;
receiving, by the computing device, a target video, the target video including a target face;
determining, by the computing device based on the target video, target face parameters associated with the parametric face model and corresponding to the target face; and
synthesizing, by the computing device using the parametric face model, based on the source face parameters and the target face parameters, an output face, the output face including the source face imitating a facial expression of the target face.