US 11,727,617 B2
Single image-based real-time body animation
Egor Nemchinov, Saint-Petersburg (RU); Sergei Gorbatyuk, Saint-Petersburg (RU); Aleksandr Mashrabov, Sochi (RU); Egor Spirin, Saint-Petersburg (RU); Iaroslav Sokolov, Saint-Petersburg (RU); Andrei Smirdin, Saint-Petersburg (RU); and Igor Tukh, Saint-Petersburg (RU)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Mar. 16, 2022, as Appl. No. 17/695,902.
Application 17/695,902 is a continuation of application No. 17/062,309, filed on Oct. 2, 2020, granted, now 11,308,676.
Application 17/062,309 is a continuation of application No. 16/434,185, filed on Jun. 7, 2019, granted, now 10,839,586, issued on Nov. 17, 2020.
Prior Publication US 2022/0207810 A1, Jun. 30, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 13/40 (2011.01); G06T 7/194 (2017.01); G06N 3/08 (2023.01); G06T 3/00 (2006.01); G06T 15/04 (2011.01); G06T 17/20 (2006.01)
CPC G06T 13/40 (2013.01) [G06N 3/08 (2013.01); G06T 3/0037 (2013.01); G06T 7/194 (2017.01); G06T 15/04 (2013.01); G06T 17/20 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for single image-based body animation, the method comprising:
receiving, by a computing device, an input image, the input image including a body image of a person;
extracting, by the computing device, the body image of the person from the input image;
fitting, by the computing device, a generic model to the body image, wherein the generic model is configured to:
receive a set of pose parameters corresponding to a pose of the person; and
generate, based on the set of pose parameters, a generic body shape adopting the pose;
generating, by the computing device and based on the body image and the generic model, a three-dimensional (3D) model, wherein the 3D model is configured to:
receive a set of further pose parameters corresponding to the pose of the person; and
generate, based on the set of further pose parameters, an output image of the person adopting the pose, the output image including at least one feature of the body image of the person being omitted from the generic body shape; and
providing, by the computing device to the 3D model, at least one further set of further pose parameters corresponding to a further pose of the person to generate a frame of an output video, the frame including a further output image of the person adopting the further pose.