US 11,706,421 B2
Inter prediction with refinement in video processing
Kai Zhang, San Diego, CA (US); Li Zhang, San Diego, CA (US); Hongbin Liu, Beijing (CN); and Yue Wang, Beijing (CN)
Assigned to BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., Beijing (CN); and BYTEDANCE INC., Los Angeles, CA (US)
Filed by Beijing Bytedance Network Technology Co., Ltd., Beijing (CN); and Bytedance Inc., Los Angeles, CA (US)
Filed on Jun. 14, 2021, as Appl. No. 17/346,568.
Application 17/346,568 is a continuation of application No. 16/998,406, filed on Aug. 20, 2020, granted, now 11,064,206.
Application 16/998,406 is a continuation of application No. PCT/CN2019/115695, filed on Nov. 5, 2019.
Claims priority of application No. PCT/CN2018/113928 (WO), filed on Nov. 5, 2018.
Prior Publication US 2022/0086458 A1, Mar. 17, 2022
Int. Cl. H04N 19/159 (2014.01); H04N 19/172 (2014.01); H04N 19/176 (2014.01); H04N 19/96 (2014.01); H04N 19/117 (2014.01); H04N 19/132 (2014.01); H04N 19/186 (2014.01); H04N 19/105 (2014.01); H04N 19/513 (2014.01)
CPC H04N 19/159 (2014.11) [H04N 19/105 (2014.11); H04N 19/117 (2014.11); H04N 19/132 (2014.11); H04N 19/172 (2014.11); H04N 19/176 (2014.11); H04N 19/186 (2014.11); H04N 19/513 (2014.11); H04N 19/96 (2014.11)] 20 Claims
OG exemplary drawing
 
1. A method of processing video data, comprising:
determining two corresponding regions for a sub-block of a current video block of a current picture of a video, wherein the two corresponding regions are in two reference pictures of the current video block, respectively;
deriving a sum of absolute difference (SAD) based on partial samples of the two corresponding regions;
determining that a first prediction mode is applied to the sub-block based on the SAD, wherein, in the first prediction mode, prediction samples of the sub-block are refined based on at least gradient values in different directions; and
performing, based on the first prediction mode, a conversion between the sub-block and a bitstream of the video;
wherein, in the first prediction mode, τ0×τ1>0, wherein τ0 is a difference between a picture order count of the current picture and a picture order count of a first reference picture (R0) of the two reference pictures (τ0=POC(current)−POC(R0)), and wherein τ1 is a difference between a picture order count of a second reference picture (R1) of the two reference pictures and the picture order count of the current picture (τ1=POC(R1)−POC(current)).