US 12,273,499 B2
Methods, devices and stream for encoding and decoding three degrees of freedom and volumetric compatible video stream
Renaud Dore, Cesson-Sevigne (FR); Julien Fleureau, Cesson-Sevigne (FR); Bertrand Chupeau, Cesson-Sevigne (FR); Gerard Briand, Cesson-Sevigne (FR); Thierry Tapie, Cesson-Sevigne (FR); and Franck Thudor, Cesson-Sevigne (FR)
Assigned to InterDigital VC Holdings, Inc., Wilmington, DE (US)
Appl. No. 16/647,517
Filed by InterDigital VC Holdings, Inc., Wilmington, DE (US)
PCT Filed Sep. 11, 2018, PCT No. PCT/US2018/050407
§ 371(c)(1), (2) Date Mar. 15, 2020,
PCT Pub. No. WO2019/055389, PCT Pub. Date Mar. 21, 2019.
Claims priority of application No. 17306188 (EP), filed on Sep. 15, 2017; and application No. 18305949 (EP), filed on Jul. 13, 2018.
Prior Publication US 2020/0228777 A1, Jul. 16, 2020
Int. Cl. H04N 13/161 (2018.01); G06T 9/00 (2006.01); G06T 15/20 (2011.01); H04N 13/122 (2018.01); H04N 13/15 (2018.01); H04N 13/178 (2018.01); H04N 19/597 (2014.01)
CPC H04N 13/161 (2018.05) [H04N 13/122 (2018.05); H04N 13/15 (2018.05); H04N 13/178 (2018.05); H04N 19/597 (2014.11)] 17 Claims
OG exemplary drawing
 
1. A method of generating a stream representative of a 3D scene, the method comprising:
generating first color data by projecting first points of the 3D scene visible for 360 degrees from a first point of view onto a first color map, said first color data being a color image adapted to a rendering enabling three degrees of freedom of rotation around said first point of view;
generating first depth data by projecting said first points onto a first depth map, said first depth data being encoded as patch pictures packed in a depth atlas associated with metadata comprising information mapping a depth patch picture with a pixel area of said color image, wherein a patch picture comprises the points projected onto a projection map which define an area of adjacent pixels in the projection map and which are depth consistent, and wherein an atlas is an image gathering patch pictures;
generating second color data and second depth data representative of second points of the 3D scene visible for 360 degrees from a plurality of second points of view within a space of view around said first point of view, wherein said second points are visible from at least one of the plurality of second points of view and invisible from said first point of view; and
encoding, in said stream, a header, a first element of syntax encoding said first color data, and a second element of syntax encoding said first depth data, said second color data, said second depth data, and said metadata.