US 12,267,478 B2
Method and device for compressing data representative of a volumetric three-dimensional scene with a view to real-time decompression for online viewing
Michaël Adam, Grenoble (FR); and Clément Menier, Grenoble (FR)
Assigned to 4D VIEW SOLUTIONS, Grenoble (FR)
Appl. No. 18/267,894
Filed by 4D VIEW SOLUTIONS, Grenoble (FR)
PCT Filed Dec. 9, 2021, PCT No. PCT/FR2021/052252
§ 371(c)(1), (2) Date Jun. 16, 2023,
PCT Pub. No. WO2022/129737, PCT Pub. Date Jun. 23, 2022.
Claims priority of application No. 2013513 (FR), filed on Dec. 17, 2020.
Prior Publication US 2024/0040101 A1, Feb. 1, 2024
Int. Cl. H04N 7/12 (2006.01); H04N 13/161 (2018.01); H04N 19/172 (2014.01); H04N 19/176 (2014.01)
CPC H04N 13/161 (2018.05) [H04N 19/172 (2014.11); H04N 19/176 (2014.11)] 15 Claims
OG exemplary drawing
 
1. A method for compressing a volumetric video stream of a three-dimensional action scene represented by a plurality of frames, the method being implemented by computer, and according to which a mesh and a texture for each frame of the scene are generated and groups of frames each comprising a key frame and inter-frames are defined, the meshes thereof being defined with respect to the mesh of the corresponding key frame, the method comprising a step of compressing information representative of the textures and wherein the texture compression step comprises, for each frame group, the steps of:
compressing the information representative of the textures of each of the frames of the group according to a block compression method producing an encoding of the texture by blocks of pixels of the same size, each encoded block being independent of the other blocks, the compression method therefore being capable of forming blocks directly usable by a conventional graphics processing unit according to standard algorithms such as DXT, ASTC or PVRTC, thus defining blocks of pixels directly usable by a conventional graphics processing unit, and comprising blocks associated with the key frame and blocks respectively associated with each of the inter-frames;
determining, from the blocks associated with the key frame and blocks associated with the inter-frames, on the one hand, first blocks capable of forming a composite texture of the key frame, and on the other hand second blocks capable of modifying, by means of iterative replacement of blocks, the composite texture of the key frame by copying these second blocks into the composite texture so as to form approximated textures of the inter-frames;
forming a composite texture of the key frame of the group of frames from first blocks associated with the key frame and first blocks associated with the inter-frames, and encoding said composite texture; and
encoding the textures of the inter-frames based on the composite texture of the key frame and the second blocks.