| CPC H04N 19/54 (2014.11) [G06N 3/045 (2023.01); H04L 65/70 (2022.05); H04N 19/137 (2014.11); H04N 19/149 (2014.11); H04N 19/172 (2014.11)] | 20 Claims |
|
1. A method comprising:
accessing a sequence of image frames from a first computing device, the sequence of image frames comprising a first image frame and a second image frame;
detecting a network speed associated with a network that is communicatively linked with the first computing device;
determining that the network speed falls below a predefined threshold speed;
in response to determining that the network speed falls below the predefined threshold speed:
detecting, using a motion estimation machine learning model, a first set of keypoints for the first image frame;
transmitting, via the network, the first image frame and the first set of keypoints to a second computing device;
detecting, using the motion estimation machine learning model, a second set of keypoints for the second image frame;
transmitting, via the network, the second set of keypoints to the second computing device;
based on the first set of keypoints and the second set of keypoints, predicting a dense motion field from the sequence of image frames to the first image frame and generating an occlusion mask for the sequence of image frames; and
causing an animated image to be displayed on the second computing device, the animated image generated using an image generation neural network trained to warp the first image frame according to the dense motion field and the occlusion mask to generate the animated image.
|