US 12,367,883 B2
Multisignal audio coding using signal whitening as processing
Eleni Fotopoulou, Erlangen (DE); Markus Multrus, Erlangen (DE); Sascha Dick, Erlangen (DE); Goran Markovic, Erlangen (DE); Pallavi Maben, Erlangen (DE); Srikanth Korse, Erlangen (DE); Stefan Bayer, Erlangen (DE); Sascha Disch, Erlangen (DE); and Jürgen Herre, Erlangen (DE)
Assigned to FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V., Munich (DE)
Filed by Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V., Munich (DE)
Filed on Dec. 17, 2020, as Appl. No. 17/124,628.
Application 17/124,628 is a continuation of application No. PCT/EP2019/067256, filed on Jun. 27, 2019.
Claims priority of application No. 18181767 (EP), filed on Jul. 4, 2018.
Prior Publication US 2021/0104249 A1, Apr. 8, 2021
Int. Cl. G06F 17/00 (2019.01); G06F 3/16 (2006.01); G10L 19/008 (2013.01); G10L 19/03 (2013.01)
CPC G10L 19/008 (2013.01) [G06F 3/162 (2013.01); G10L 19/03 (2013.01)] 19 Claims
OG exemplary drawing
 
1. Multisignal encoder for encoding at least three audio signals, comprising:
a signal preprocessor for individually preprocessing each audio signal to acquire at least three preprocessed audio signals, wherein the preprocessing is performed so that a preprocessed audio signal is whitened with respect to the signal before preprocessing;
an adaptive joint signal processor for performing a processing of the at least three preprocessed audio signals subsequent to an energy level normalization performed by the adaptive joint signal processor to acquire, in a first alternative, at least three jointly processed signals or, in a second alternative, at least two jointly processed signals and an unprocessed signal,
wherein, for performing the energy level normalization, the adaptive joint signal processor is configured to:
calculate an information on a mean energy of the preprocessed audio signals;
calculate an information on an energy of each preprocessed audio signal,
calculate a broadband energy normalization value for a specific preprocessed audio signal based on the information on the mean energy and the information on the energy of the specific preprocessed audio signal, and
perform a broadband energy normalization of the at least three preprocessed audio signals using the broadband energy normalization values for the specific preprocessed audio signals, wherein each preprocessed audio signal has a normalized energy due to the performing the broadband energy normalization;
wherein the adaptive joint signal processor is configured:
to calculate cross-correlation values for each possible signal pair of the preprocessed signals having the normalized energies of the at least three preprocessed signals;
to select the signal pair having the highest cross-correlation value;
to determine a joint stereo processing mode for the selected signal pair; and
to joint stereo process the selected signal pair in accordance with the determined joint stereo processing mode to obtain a processed signal pair;
a signal encoder for encoding each signal to acquire one or more encoded signals; and
an output interface for transmitting or storing an encoded multisignal audio signal comprising the one or more encoded signals, side information relating to the preprocessing comprising the broadband energy normalization values for the preprocessed audio signals and side information relating to the processing.