US 12,475,671 B2
Processing image data
Matthias Treder, London (GB); Aaron Chadha, London (GB); Ilya Fadeev, London (GB); and Ioannis Andreopoulos, London (GB)
Assigned to Sony Interactive Entertainment Europe Limited, London (GB)
Filed by Sony Interactive Entertainment Europe Limited, London (GB)
Filed on Dec. 3, 2021, as Appl. No. 17/542,239.
Claims priority of application No. 20210100684 (GR), filed on Oct. 7, 2021.
Prior Publication US 2023/0112647 A1, Apr. 13, 2023
Int. Cl. G06V 10/25 (2022.01); G06N 3/045 (2023.01); G06N 3/084 (2023.01); G06V 10/75 (2022.01); G06V 10/82 (2022.01)
CPC G06V 10/25 (2022.01) [G06N 3/045 (2023.01); G06N 3/084 (2013.01); G06V 10/751 (2022.01); G06V 10/82 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A computer-implemented method of processing image data, the method comprising:
receiving pixel data of a first image;
preprocessing the received pixel data to identify a subset of the pixel data of the first image, the subset of the pixel data corresponding to a region of interest of the first image depicting at least one scene element;
first processing the subset of the pixel data of the first image at a first encoder to generate a first data structure representative of the region of interest of the first image, the first data structure comprising a scene element identifier identifying the at least one scene element depicted in the region of interest of the first image, wherein the scene element identifier is invariant to changes in a configuration of the at least one scene element between different images depicting the at least one scene element;
second processing the subset of the pixel data of the first image at a second encoder to generate a second data structure representative of the region of interest of the first image, the second data structure comprising values for one or more visual characteristics associated with the at least one scene element depicted in the region of interest of the first image; and
outputting the first data structure and the second data structure for use by a decoder to generate a second image approximating the region of interest of the first image,
wherein the one or more visual characteristics, the values of which are to be included in the second data structure, are determined by the second encoder based on the identity of the at least one scene element as determined by the first encoder.