US 11,983,904 B2
Method for compressing point clouds
Ricardo Lopes De Queiroz, Brasilia (BR); Camilo Chang Dorea, Brasilia (BR); Renan Utida Barbosa Ferreira, Brasília (BR); Davi Rabbouni De Carvalho Freitas, Brasília (BR); Diogo Caetano Garcia, Brasilia (BR); Rogério Higa, Campinas (BR); Ismael Seidel, Campinas (BR); and Vanessa Testoni, Campinas (BR)
Assigned to SAMSUNG ELETRONICA DA AMAZONIA LTDA., Campinas (BR)
Filed by SAMSUNG ELETRÔNICA DA AMAZÔNIA LTDA., São Paulo (BR)
Filed on Apr. 23, 2021, as Appl. No. 17/238,896.
Prior Publication US 2022/0108481 A1, Apr. 7, 2022
Int. Cl. G06T 9/00 (2006.01); G06T 3/40 (2006.01); H04N 19/184 (2014.01); H04N 19/186 (2014.01); H04N 19/30 (2014.01); H04N 19/597 (2014.01); H04N 19/625 (2014.01)
CPC G06T 9/001 (2013.01) [G06T 3/40 (2013.01); H04N 19/184 (2014.11); H04N 19/186 (2014.11); H04N 19/30 (2014.11); H04N 19/597 (2014.11); H04N 19/625 (2014.11)] 13 Claims
OG exemplary drawing
 
1. A method of compressing point clouds comprising:
inserting plenoptic point clouds into a video-based point clouds encoder, where geometry information is encoded as projection images and sent to a video encoder along with auxiliary information;
processing a main attribute image using an image padding technique that fills an empty space between valid information to generate an image suitable for video compression;
using a reconstructed occupancy map to locate the empty space and filling attribute images;
sending plenoptic attribute images to a Plenoptic Attribute Encoder;
separating color information projected into the main attribute image and the plenoptic attribute images;
compressing, by a video compression encoder, the filled image generating a main attribute sub-bitstream that is sent to a multiplexer and embedded in a compressed bitstream;
sending a main reconstructed attribute image and plenoptic visualization attribute images to the Plenoptic Attribute Encoder;
generating attribute sub-bitstreams and plenoptic metadata;
sending the attribute sub-bitstreams and the plenoptic metadata to the multiplexer to be embedded in the compressed bitstream; and
executing a processing by the Plenoptic Attribute Encoder, the processing including:
using, by a differential encoder, a reconstructed attribute image and the plenoptic visualization attribute images to generate differential images,
using a transform to convert the differential images into a compact representation of information,
scaling the compact representation of information to perform mapping to a range supported by video compression,
image padding the scaled compact representation of information to generate appropriate images for video compression,
compressing the appropriate images to generate plenoptic attributes sub-bitstreams, and
sending metadata generated by the transform and scaling to the compressed bitstream.