US 11,915,355 B2
Realistic head turns and face animation synthesis on mobile device
Yurii Volkov, Santa Monica, CA (US); Pavel Savchenkov, London (GB); Nikolai Smirnov, London (GB); and Aleksandr Mashrabov, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Aug. 5, 2022, as Appl. No. 17/881,947.
Application 17/881,947 is a continuation of application No. 16/662,743, filed on Oct. 24, 2019, granted, now 11,410,364.
Application 16/662,743 is a continuation in part of application No. 16/509,370, filed on Jul. 11, 2019, granted, now 11,114,086, issued on Sep. 7, 2021.
Application 16/509,370 is a continuation in part of application No. 16/251,436, filed on Jan. 18, 2019, granted, now 10,789,453, issued on Sep. 29, 2020.
Claims priority of provisional application 62/892,562, filed on Aug. 28, 2019.
Prior Publication US 2022/0392133 A1, Dec. 8, 2022
Int. Cl. G06T 13/40 (2011.01); G06T 7/70 (2017.01); G06V 40/16 (2022.01)
CPC G06T 13/40 (2013.01) [G06T 7/70 (2017.01); G06V 40/165 (2022.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20132 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, by a computing device, a source frame of a source video, the source frame including a head and a face of a source actor;
generating, by the computing device and based on the source frame, source pose parameters corresponding to a pose of the head of the source actor and a facial expression of the source actor in the source frame of the source video, the source pose parameters including source identity information associated with the face of the source actor;
receiving, by the computing device, a target image including a target head and a target face of a target person;
determining, by the computing device, target identity information associated with the target head and the target face of the target person;
replacing, by the computing device, based on the target image, the source identity information in the source pose parameters with the target identity information to obtain further source pose parameters; and
generating, by the computing device and based on the target identity information and the further source pose parameters, an output frame of an output video, the output frame including a modified image of the target face and the target head, the target face and the target head adopting the pose of the head and the facial expression of the source actor.