US 12,348,713 B2
Sample determination for adaptive loop filtering
Li Zhang, San Diego, CA (US); Kai Zhang, San Diego, CA (US); Hongbin Liu, Beijing (CN); and Yue Wang, Beijing (CN)
Assigned to BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., Beijing (CN); and BYTEDANCE INC., Los Angeles, CA (US)
Filed by Beijing Bytedance Network Technology Co., Ltd., Beijing (CN); and Bytedance Inc., Los Angeles, CA (US)
Filed on Nov. 7, 2023, as Appl. No. 18/503,773.
Application 18/503,773 is a continuation of application No. 17/856,601, filed on Jul. 1, 2022, granted, now 11,831,869.
Application 17/856,601 is a continuation of application No. 17/570,682, filed on Jan. 7, 2022, granted, now 11,553,179, issued on Jan. 10, 2023.
Application 17/570,682 is a continuation of application No. PCT/CN2020/100962, filed on Jul. 9, 2020.
Claims priority of application No. PCT/CN2019/095330 (WO), filed on Jul. 9, 2019.
Prior Publication US 2024/0098260 A1, Mar. 21, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 19/117 (2014.01); H04N 19/132 (2014.01); H04N 19/14 (2014.01); H04N 19/176 (2014.01); H04N 19/82 (2014.01); H04N 19/96 (2014.01)
CPC H04N 19/117 (2014.11) [H04N 19/132 (2014.11); H04N 19/14 (2014.11); H04N 19/176 (2014.11); H04N 19/82 (2014.11); H04N 19/96 (2014.11)] 20 Claims
OG exemplary drawing
 
1. A method of processing video data, comprising:
determining, for a conversion between a picture of a video comprising one or more coding tree blocks and a bitstream of the video, that an adaptive loop filtering process is applied to a current coding tree block of the one or more coding tree blocks;
determining a classification of an M×N region of the current coding tree block based on gradients derived from a P×Q region including the M×N region according to a rule, wherein the rule disallows use of a sample in the P×Q region across one or more boundaries of multiple kinds of video regions, and wherein the picture is divided into multiple kinds of video regions and the one or more boundaries at least comprise a 360-degree virtual boundary or a picture boundary, where M, N, P, and Q are positive integers, P is greater than M, and Q is greater than N; and
performing the conversion by applying the adaptive loop filtering process according to the determined classification, wherein the adaptive loop filtering process comprises:
deriving a filtering coefficient set for the M×N region based on the determined classification;
determining a clipping value set for the M×N region; and
performing a filtering operation based on the filtering coefficient set and the clipping value set,
wherein the one or more boundaries conditionally further comprise at least one of: a slice boundary, a tile boundary, or a sub-picture boundary.