US 11,889,099 B2
Methods and apparatuses of video processing for bi-directional prediction with motion refinement in video coding systems
Ching-Yeh Chen, Hsinchu (TW); and Tzu-Der Chuang, Hsinchu (TW)
Assigned to HFI INNOVATION INC., Zhubei (TW)
Appl. No. 17/435,440
Filed by MEDIATEK INC., Hsinchu (TW)
PCT Filed Mar. 2, 2020, PCT No. PCT/CN2020/077430
§ 371(c)(1), (2) Date Sep. 1, 2021,
PCT Pub. No. WO2020/177665, PCT Pub. Date Sep. 10, 2020.
Claims priority of provisional application 62/813,806, filed on Mar. 5, 2019.
Prior Publication US 2022/0060735 A1, Feb. 24, 2022
Int. Cl. H04N 19/513 (2014.01); H04N 19/105 (2014.01); H04N 19/132 (2014.01); H04N 19/159 (2014.01); H04N 19/176 (2014.01)
CPC H04N 19/513 (2014.11) [H04N 19/105 (2014.11); H04N 19/132 (2014.11); H04N 19/159 (2014.11); H04N 19/176 (2014.11)] 9 Claims
OG exemplary drawing
 
1. A method of processing video data by bi-directional prediction in a video coding system, comprising:
receiving input data associated with a current block coded or to be coded by bi-directional prediction in a current picture;
determining a List 0 reference block for the current block by performing motion compensation from a reference picture in List 0 and determining a List 1 reference block for the current block by performing motion compensation from a reference picture in List 1;
performing a motion vector refinement using a motion estimation search to refine the List 0 and List 1 reference blocks by finding a location corresponding to a minimum motion estimation cost around the List 0 reference block and a location corresponding to a minimum motion estimation cost around the List 1 reference block, wherein cost calculation for finding the minimum most estimation costs in the motion vector refinement is performed on each processing unit in the current block;
determining whether a Bi-Directional Optical Flow (BDOF) operation is early terminated according to a cost of the refined List 0 and List 1 reference blocks of each processing unit in the current block, wherein the processing unit for BDOF early termination is aligned with the processing unit for the motion vector refinement;
skipping the BDOF operation if the BDOF operation is early terminated and deriving a final inter predictor for the current block according to the refined List 0 and List 1 reference blocks, or performing the BDOF operation by deriving BDOF parameters to further derive the inter predictor for the current block according to the refined List 0 and List 1 reference blocks if the BDOF operation is not early terminated, wherein the BDOF operation derives sample-based refinement through optical flow;
and
encoding or decoding the current block according to the final inter predictor of the current block.