US 11,706,462 B2
Padding process at unavailable sample locations in adaptive loop filtering
Hongbin Liu, Beijing (CN); Li Zhang, San Diego, CA (US); Kai Zhang, San Diego, CA (US); and Yue Wang, Beijing (CN)
Assigned to BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD, Beijing (CN); and BYTEDANCE INC., Los Angeles, CA (US)
Filed by Beijing Bytedance Network Technology Co., Ltd., Beijing (CN); and Bytedance Inc., Los Angeles, CA (US)
Filed on Apr. 8, 2022, as Appl. No. 17/716,380.
Application 17/716,380 is a continuation of application No. PCT/CN2020/120063, filed on Oct. 10, 2020.
Claims priority of application No. PCT/CN2019/110489 (WO), filed on Oct. 10, 2019; application No. PCT/CN2019/110681 (WO), filed on Oct. 11, 2019; and application No. PCT/CN2019/111114 (WO), filed on Oct. 14, 2019.
Prior Publication US 2023/0090209 A1, Mar. 23, 2023
Int. Cl. H04N 19/82 (2014.01); H04N 19/174 (2014.01); H04N 19/117 (2014.01); H04N 19/176 (2014.01)
CPC H04N 19/82 (2014.11) [H04N 19/117 (2014.11); H04N 19/174 (2014.11); H04N 19/176 (2014.11)] 19 Claims
OG exemplary drawing
 
1. A method of processing video data, comprising:
determining, for a conversion between a current block of a video and a bitstream of the video, that one or more above-left neighboring samples outside the current block are unavailable for a coding tool applied to the current block;
padding the one or more above-left neighboring samples with above neighboring samples outside the current block, in case that left neighboring samples outside the current block are available and the above neighboring samples are available; and
performing the conversion based on the padded one or more above-left neighboring samples,
wherein the padded one or more above-left neighboring samples are used for a classification operation in an adaptive loop filter process of the coding tool, wherein the padded one or more above-left neighboring samples are used to determine a classification filter index in the classification operation, and the classification filter index is utilized to determine a filtering coefficient set,
wherein during the classification operation, a classification of an M×N region of the current block is determined based on gradients of a subset of samples of a P×Q region including the M×N region, wherein the current block is a coding tree block, where the M×N region is a 4*4 region and the P×Q region is an 8*8 region, and
wherein when there is a sample in a 4×4 block located at a left boundary of the current block, left-most two columns of samples in an 8×8 region are padded, or when there is a sample in a 4×4 block located at a top boundary of the current block, top-most two lines of samples in a 8×8 region are padded.