US 11,792,450 B2
Broadcast streaming of panoramic video for interactive clients
Karsten Grüneberg, Berlin (DE); Serhan Gül, Berlin (DE); Cornelius Hellge, Berlin (DE); Yago Sánchez, Berlin (DE); Thomas Schierl, Berlin (DE); and Robert Skupin, Berlin (DE)
Assigned to FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG, Der Angewandten Forschung E.V. München (DE)
Filed by Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V., Munich (DE)
Filed on Nov. 23, 2018, as Appl. No. 16/198,957.
Application 16/198,957 is a continuation of application No. PCT/EP2017/057334, filed on Mar. 28, 2017.
Claims priority of application No. 16171579 (EP), filed on May 26, 2016.
Prior Publication US 2019/0098348 A1, Mar. 28, 2019
Int. Cl. H04N 21/234 (2011.01); H04N 21/236 (2011.01); H04N 21/845 (2011.01); H04N 21/434 (2011.01); H04N 21/44 (2011.01); H04N 21/2343 (2011.01); H04N 21/2362 (2011.01); H04N 21/2365 (2011.01); H04N 21/4402 (2011.01)
CPC H04N 21/234345 (2013.01) [H04N 21/2362 (2013.01); H04N 21/2365 (2013.01); H04N 21/4345 (2013.01); H04N 21/4347 (2013.01); H04N 21/4402 (2013.01); H04N 21/8451 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A stream demultiplexer, comprising:
a data stream former configured to selectively extract at least two separate substreams from a group of separate substreams, the at least two separate substreams comprising encoded data coding different spatial segments or different groups of subsequent spatial segments of a video picture of a video stream, wherein the data stream former is configured to combine the at least two separate substreams to a data stream comprising the encoded data coding the different spatial segments or different groups of subsequent spatial segments of the video picture of the video stream, wherein the different spatial segments or different groups of subsequent spatial segments of the video picture of the video stream are encoded such that the encoded data comprises, for each spatial segment or group of spatial segments, at least one slice, wherein the slice or slices for each spatial segment or group of spatial segments are packetized into one separate substream, wherein the slices of at least one of the spatial segments or groups of subsequent spatial segments are packetized into the separate substream, wherein a further separate substream comprises suitable slice headers which are, relative to the slices of the at least one of the spatial segments or groups of subsequent spatial segments, modified with respect to its picture position or picture size; and
an output interface configured to provide the data stream;
wherein the data stream former is configured to combine the at least two separate substreams to a HEVC standard conformant data stream,
wherein the data stream former is configured to modify a header information of the at least two separate substreams or to add a header information to the at least two separate substreams based on the suitable slice headers comprised in the further separate sub stream, to obtain the HEVC standard conformant data stream;
wherein the group of separate substreams comprises a subgroup of one or more separate substreams
each coding a respective spatial segment or a respective group of subsequent spatial segments,
each comprising a sequence of NAL units, and
the sequence of NAL units being composed of
a first set of one or more NAL units which forms a standard conformant version of a data stream representing the respective spatial segment or the respective group of subsequent spatial segments of the respective substream, and
a second set of one or more NAL units which are of one of a set of one or more predetermined NAL unit types for ignorance of the respective NAL unit by a legacy decoder.