CPC G06V 40/172 (2022.01) [G06T 3/4007 (2013.01); G06T 5/002 (2013.01); G06T 5/50 (2013.01); G06T 7/248 (2017.01); G06V 20/40 (2022.01); G06T 2207/10016 (2013.01); G06T 2207/20212 (2013.01); G06T 2207/30201 (2013.01)] | 20 Claims |
1. A computer-implemented method comprising:
receiving a set of video frames that correspond to a video, the set of video frames including a first video frame and a second video frame that each include a face, wherein the second video frame is subsequent to the first video frame;
performing face tracking on the first video frame to identify a first face resampling keyframe;
performing face tracking on the second video frame to identify a second face resampling keyframe;
deriving an interpolation amount;
interpolating a first background of the first face resampling keyframe and a second background of the second face resampling keyframe based on the interpolation amount;
rendering an interpolated first face and an interpolated second face; and
displaying a final frame that is based on the interpolated first background, the interpolated second background, the interpolated first face, and the interpolated second face.
|