US 11,810,331 B2
Neural image compression with latent feature-domain intra-prediction
Wei Jiang, Sunnyvale, CA (US); Wei Wang, Palo Alto, CA (US); Ding Ding, Palo Alto, CA (US); Shan Liu, San Jose, CA (US); and Xiaozhong Xu, State College, PA (US)
Assigned to TENCENT AMERICA LLC, Palo Alto, CA (US)
Filed by TENCENT AMERICA LLC, Palo Alto, CA (US)
Filed on Aug. 31, 2021, as Appl. No. 17/462,287.
Claims priority of provisional application 63/133,704, filed on Jan. 4, 2021.
Prior Publication US 2022/0215592 A1, Jul. 7, 2022
Int. Cl. G06T 9/00 (2006.01); H04N 19/124 (2014.01); H04N 19/159 (2014.01); H04N 19/176 (2014.01); H04N 19/13 (2014.01); G06N 3/045 (2023.01)
CPC G06T 9/002 (2013.01) [G06N 3/045 (2023.01); H04N 19/124 (2014.11); H04N 19/13 (2014.11); H04N 19/159 (2014.11); H04N 19/176 (2014.11)] 20 Claims
OG exemplary drawing
 
1. A method of decoding a neural image with latent feature-domain intra-prediction, the method being performed by at least one processor, and the method comprising:
receiving a set of latent blocks, and for each of the blocks in the set of latent blocks:
predicting a block, based on a set of previously recovered blocks, using a first neural network;
receiving a selection signal indicating a currently recovered block;
based on the received selection signal, performing one of (1) and (2):
(1) generating a compact residual, a set of residual context parameters, and a decoded residual; and
generating a first decoded block, based on the predicted block and the decoded residual;
(2) generating a second decoded block, based on a compact representation block and a set of context parameters;
generating a set of recovered blocks comprising each of the currently recovered blocks;
generating a recovered latent image by merging all the blocks in the set of recovered blocks; and
decoding the generated recovered latent image, using a second neural network, to obtain a reconstructed image.