US 12,262,065 B2
Restoration for video coding with self-guided filtering and subspace projection
Debargha Mukherjee, Cupertino, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Feb. 9, 2024, as Appl. No. 18/437,402.
Application 18/437,402 is a continuation of application No. 17/866,631, filed on Jul. 18, 2022, granted, now 11,924,476.
Application 17/866,631 is a continuation of application No. 16/666,676, filed on Oct. 29, 2019, granted, now 11,405,653, issued on Aug. 2, 2022.
Application 16/666,676 is a continuation of application No. 15/719,918, filed on Sep. 29, 2017, granted, now 10,477,251, issued on Nov. 12, 2019.
Claims priority of provisional application 62/417,545, filed on Nov. 4, 2016.
Prior Publication US 2024/0179352 A1, May 30, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 19/86 (2014.01); G06T 5/70 (2024.01); H04N 19/117 (2014.01); H04N 19/136 (2014.01); H04N 19/174 (2014.01); H04N 19/176 (2014.01); H04N 19/182 (2014.01); H04N 19/192 (2014.01); H04N 19/46 (2014.01); H04N 19/80 (2014.01); H04N 19/85 (2014.01); H04N 19/463 (2014.01)
CPC H04N 19/865 (2014.11) [G06T 5/70 (2024.01); H04N 19/117 (2014.11); H04N 19/136 (2014.11); H04N 19/174 (2014.11); H04N 19/176 (2014.11); H04N 19/182 (2014.11); H04N 19/192 (2014.11); H04N 19/46 (2014.11); H04N 19/80 (2014.11); H04N 19/85 (2014.11); H04N 19/86 (2014.11); G06T 2207/20021 (2013.01); G06T 2207/20192 (2013.01); H04N 19/463 (2014.11)] 20 Claims
OG exemplary drawing
 
1. A device, comprising:
a processor configured to:
restore a portion Y of a degraded frame using a projection operation that uses a first projection parameter α, a second projection parameter β, and at least two guide portions, wherein to restore the portion Y of the degraded frame comprises to:
generate, using first restoration parameters, a first guide portion Y1 for the portion Y;
generate, using second restoration parameters, a second guide portion Y2 for the portion Y; and
generate a reconstructed portion YR, wherein the projection operation is based on α(Y1−Y)+(Y2−Y),
wherein to generate the first guide portion or to generate the second guide portion comprises to:
 obtain a respective radius r and a respective noise value e for a guide portion, wherein the guide portion is one of the first guide portion or the second guide portion;
 calculate a respective mean and a respective variance for each pixel of at least some pixels of the portion Y in a (2r+1)(2r+1) window centered at the each pixel; and
 calculate a guide pixel of the guide portion corresponding to the each pixel based on the respective variance and the respective mean.