US 12,243,192 B2
Video smoothing mechanism
Satyam Srivastava, Rancho Cordova, CA (US); Saurabh Tangri, Folsom, CA (US); Rajeev Nalawadi, El Dorado Hills, CA (US); Carl S. Marshall, Portland, OR (US); and Selvakumar Panneer, Portland, OR (US)
Assigned to Intel Corporation, Santa Clara, CA (US)
Filed by Intel Corporation, Santa Clara, CA (US)
Filed on Jun. 22, 2021, as Appl. No. 17/354,186.
Prior Publication US 2022/0405888 A1, Dec. 22, 2022
Int. Cl. G06T 5/70 (2024.01); G06N 3/045 (2023.01); G06N 3/08 (2023.01); G06T 3/40 (2024.01); G06T 5/50 (2006.01)
CPC G06T 5/70 (2024.01) [G06N 3/045 (2023.01); G06N 3/08 (2013.01); G06T 3/40 (2013.01); G06T 5/50 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An apparatus to facilitate video motion smoothing, comprising:
one or more processors including a graphics processor, the one or more processors including circuitry configured to:
receive a video stream;
decode the video stream to generate a motion vector map and a plurality of video image frames;
analyze, via a convolutional neural network (CNN), the motion vector map to detect a plurality of candidate frames, wherein the plurality of candidate frames comprise a period of discontinuous motion in the plurality of video image frames classified as a type of the discontinuous motion to be smoothened;
generate, via a generative adversarial network (GAN), one or more synthetic frames based on the plurality of candidate frames;
insert the one or more synthetic frames between the plurality of candidate frames to generate up-sampled video frames; and
transmit the up-sampled video frames for display.