US 11,995,758 B2
Photorealistic real-time portrait animation
Eugene Krokhalev, London (GB); Aleksandr Mashrabov, Los Angeles, CA (US); and Pavel Savchenkov, London (GB)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Dec. 14, 2022, as Appl. No. 18/080,779.
Application 18/080,779 is a continuation of application No. 17/751,796, filed on May 24, 2022, granted, now 11,568,589.
Application 17/751,796 is a continuation of application No. 17/325,225, filed on May 20, 2021, granted, now 11,393,152, issued on Jul. 19, 2022.
Application 17/325,225 is a continuation of application No. 16/251,472, filed on Jan. 18, 2019, granted, now 11,049,310, issued on Jun. 29, 2021.
Prior Publication US 2023/0110916 A1, Apr. 13, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 13/80 (2011.01); G06T 7/174 (2017.01); G06V 40/16 (2022.01)
CPC G06T 13/80 (2013.01) [G06T 7/174 (2017.01); G06V 40/167 (2022.01); G06T 2207/20084 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for portrait animation, the method comprising:
receiving, by a computing device, scenario data including information concerning a first face associated with a first user and head movements of the first user;
receiving, by the computing device, a target image including a second face associated with a second user, the second user being different from the first user;
determining, by the computing device and based on the target image and the information concerning the first face, two-dimensional (2D) deformations of the second face in the target image; and
applying, by the computing device, the 2D deformations to the target image to obtain at least one output frame of an output video, wherein the output video includes the head movements of the first user.