US 12,035,018 B2
Data processor and transport of user control data to audio decoders and renderers
Stephan Schreiner, Birgland (DE); Simone Neukam, Kalchreuth (DE); Harald Fuchs, Roettenbach (DE); Jan Plogsties, Fuerth (DE); and Stefan Doehla, Erlangen (DE)
Assigned to Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V., Munich (DE)
Filed by Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V., Munich (DE)
Filed on Jul. 5, 2023, as Appl. No. 18/347,546.
Application 18/347,546 is a continuation of application No. 17/664,397, filed on May 20, 2022, granted, now 11,743,553.
Application 17/664,397 is a continuation of application No. 15/931,422, filed on May 13, 2020, granted, now 11,381,886, issued on Jul. 5, 2022.
Application 15/931,422 is a continuation of application No. 15/357,640, filed on Nov. 21, 2016, granted, now 10,674,228, issued on Jun. 2, 2020.
Application 15/357,640 is a continuation of application No. PCT/EP2015/056768, filed on Mar. 27, 2015.
Claims priority of application No. 14170416 (EP), filed on May 28, 2014.
Prior Publication US 2023/0396856 A1, Dec. 7, 2023
Int. Cl. H04N 21/81 (2011.01); G10L 19/00 (2013.01); G10L 19/16 (2013.01); H04N 21/435 (2011.01); H04N 21/4363 (2011.01); H04N 21/439 (2011.01); H04N 21/442 (2011.01); H04N 21/485 (2011.01)
CPC H04N 21/8106 (2013.01) [G10L 19/00 (2013.01); G10L 19/167 (2013.01); H04N 21/435 (2013.01); H04N 21/4363 (2013.01); H04N 21/4394 (2013.01); H04N 21/44222 (2013.01); H04N 21/44227 (2013.01); H04N 21/4852 (2013.01)] 17 Claims
OG exemplary drawing
 
1. An audio data processor for processing packetized audio data, the audio data processor comprising:
a receiver interface for receiving encoded audio data comprising audio objects and metadata related to the audio objects;
a metadata parser for parsing the metadata to determine an audio data manipulation possibility of the audio objects;
an interaction interface configured to receive an interaction input and configured to generate, from the interaction input, interaction control data related to the audio data manipulation possibility for manipulating the audio objects externally from a decoder;
a data stream generator configured to acquire the interaction control data and the encoded audio data and the metadata and configured to generate an output data stream by adding an additional data portion containing the interaction control data to the output data stream, such that the output data stream remains a valid encoded audio stream comprising the still encoded audio data, the metadata, and the additional data portion containing the added interaction control data,
wherein the additional data portion is contained in a packet type being different from packet types for the encoded audio data and the metadata, wherein the presence of said packet type indicates that an interaction input has happened, and
wherein the data stream generator is configured to include a signature into the output data stream, wherein the signature is for identifying an originator of the interaction control data.