CPC H04N 7/014 (2013.01) [G06N 3/04 (2013.01); G06N 3/08 (2013.01); H04N 7/0127 (2013.01); H04N 7/0137 (2013.01)] | 15 Claims |
1. A method for converting a frame rate of an input video, the method comprising:
performing a motion estimation by generating at least one motion field for at least one pair of frames of the input video, wherein the at least one motion field comprises a set of motion vectors for each block of a first reference frame of the input video, the set of motion vectors indicating to a second reference frame of the input video;
preparing first data for a predetermined interpolation phase for each block of an interpolated frame, wherein the first data comprise at least one parameter for a pre-trained occlusion processing (OcC) convolutional neural network (CNN), the at least one parameter being obtained based on the at least one motion field;
performing occlusion correction with the OcC CNN for each block of the interpolated frame by predicting weights associated with the set of motion vectors based on the prepared first data; and
performing motion compensation for each block or for each pixel of the interpolated frame by processing data from the OcC CNN.
|