US 12,113,985 B2
Method and data processing system for lossy image or video encoding, transmission and decoding
Bilal Abbasi, London (GB); Sebastjan Cizel, London (GB); Chris Finlay, London (GB); Christian Etmann, London (GB); and Arsalan Zafar, London (GB)
Assigned to DEEP RENDER LTD., London (GB)
Filed by DEEP RENDER LTD, London (GB)
Filed on Aug. 30, 2023, as Appl. No. 18/458,511.
Claims priority of application No. 2302350 (GB), filed on Feb. 19, 2023; and application No. 2304148 (GB), filed on Mar. 22, 2023.
Prior Publication US 2024/0291994 A1, Aug. 29, 2024
Int. Cl. H04N 7/12 (2006.01); G06T 3/18 (2024.01); H04N 19/137 (2014.01); H04N 19/172 (2014.01)
CPC H04N 19/137 (2014.11) [G06T 3/18 (2024.01); H04N 19/172 (2014.11)] 20 Claims
OG exemplary drawing
 
1. A method for lossy video encoding, transmission and decoding, the method comprising the steps of:
receiving a first frame and a second frame at a first computer system;
determining a first flow between the first frame and the second frame;
determining a second flow based on the first frame and the second frame;
encoding an input based on the first flow and the second flow using a first trained neural network to produce a latent representation;
transmitting the latent representation to a second computer system;
decoding the latent representation using a second trained neural network to produce an output flow; and
using the output flow to obtain an output frame, wherein the output frame is an approximation of the second frame;
wherein each of the first flow and the second flow define a transformation of a part of an image from a first position in the first frame to a second position in the second frame.