US 11,736,698 B2
Sub-region based determination of motion information refinement
Hongbin Liu, Beijing (CN); Li Zhang, San Diego, CA (US); Kai Zhang, San Diego, CA (US); and Yue Wang, Beijing (CN)
Assigned to BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, Beijing (CN); and BYTEDANCE INC., Los Angeles, CA (US)
Filed by Beijing Bytedance Network Technology Co., Ltd., Beijing (CN); and Bytedance Inc., Los Angeles, CA (US)
Filed on Oct. 20, 2021, as Appl. No. 17/506,578.
Application 17/506,578 is a continuation of application No. PCT/CN2020/090802, filed on May 18, 2020.
Claims priority of application No. PCT/CN2019/087193 (WO), filed on May 16, 2019; application No. PCT/CN2019/090037 (WO), filed on Jun. 4, 2019; application No. PCT/CN2019/090903 (WO), filed on Jun. 12, 2019; application No. PCT/CN2019/093616 (WO), filed on Jun. 28, 2019; application No. PCT/CN2019/093973 (WO), filed on Jun. 29, 2019; application No. PCT/CN2019/094282 (WO), filed on Jul. 1, 2019; application No. PCT/CN2019/104489 (WO), filed on Sep. 5, 2019; and application No. PCT/CN2019/116757 (WO), filed on Nov. 8, 2019.
Prior Publication US 2022/0103827 A1, Mar. 31, 2022
Int. Cl. H04N 19/137 (2014.01); H04N 19/132 (2014.01); H04N 19/159 (2014.01); H04N 19/176 (2014.01)
CPC H04N 19/137 (2014.11) [H04N 19/132 (2014.11); H04N 19/159 (2014.11); H04N 19/176 (2014.11)] 18 Claims
OG exemplary drawing
 
1. A method of processing video data, comprising:
determining, for a first conversion between a first bi-predicted video block of a video and a bitstream of the video, that a motion information of the first bi-predicted video block is refined using a first optical flow-based method in which at least one first motion vector refinement is derived to refine prediction samples of a region within the first bi-predicted video block;
clipping the at least one first motion vector refinement to a first range;
performing the first conversion based on at least one clipped first motion vector refinement;
determining, for a second conversion between a second affine video block of the video and the bitstream, that a motion information of the second affine video block is refined using a second optical flow-based method in which at least one second motion vector refinement is derived to refine prediction samples of a region within the second affine video block;
clipping the at least one second motion vector refinement to a second range; and
performing the second conversion based on at least one clipped second motion vector refinement;
wherein the first range is different from the second range;
wherein the first optical flow-based method is a bi-directional optical flow tool for bi-predicted video blocks, and the second optical flow-based method is a prediction refinement optical flow tool for affine video blocks;
wherein the first range is [−N0, M0] and the second range is [−N1, M1], wherein N0, M0, N1 and M1 are integers;
wherein N0 and M0 have a same value which is equal to 2K0−1, and N1 and M1 have a same value which is equal to 2K1−1, wherein K0 and K1 are integers;
wherein [−N0, M0] is [−15, 15]; and
wherein [−N1, M1] is [−31, 31].