US 12,143,626 B2
Systems, apparatus and methods for inter prediction refinement with optical flow
Jiancong Luo, Skillman, NJ (US); and Yuwen He, San Diego, CA (US)
Assigned to InterDigital VC Holdings, Inc., Wilmington, DE (US)
Filed by InterDigital VC Holdings, Inc., Wilmington, DE (US)
Filed on May 18, 2023, as Appl. No. 18/199,238.
Application 18/199,238 is a continuation of application No. 17/426,976, granted, now 11,695,950, previously published as PCT/US2020/016564, filed on Feb. 4, 2020.
Claims priority of provisional application 62/833,999, filed on Apr. 15, 2019.
Claims priority of provisional application 62/814,611, filed on Mar. 6, 2019.
Claims priority of provisional application 62/802,428, filed on Feb. 7, 2019.
Prior Publication US 2023/0291927 A1, Sep. 14, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 19/52 (2014.01); H04N 19/105 (2014.01); H04N 19/132 (2014.01); H04N 19/139 (2014.01); H04N 19/167 (2014.01); H04N 19/176 (2014.01); H04N 19/55 (2014.01)
CPC H04N 19/52 (2014.11) [H04N 19/105 (2014.11); H04N 19/132 (2014.11); H04N 19/139 (2014.11); H04N 19/167 (2014.11); H04N 19/176 (2014.11); H04N 19/55 (2014.11)] 20 Claims
OG exemplary drawing
 
1. A method of decoding a video, the method comprising:
generating a sub-block-based motion prediction signal for a sub-block of a block of a picture based on an affine motion model associated with said block;
determining a set of pixel-level motion vector difference values for said sub-block using said affine motion model associated with said block, wherein a pixel-level motion vector difference for a sample is based on a difference between a location of said sample and a center position of said sub-block;
determining spatial gradients of said sub-block-based motion prediction signal, for each sample location of said sub-block;
determining a motion prediction refinement signal for said sub-block, based on said determined set of pixel-level motion vector difference values and said determined spatial gradients;
combining said motion prediction signal and said motion prediction refinement signal to produce a refined motion prediction signal for said sub-block; and
decoding the video using the refined motion prediction signal.