US 12,225,370 B2
Apparatus for immersive spatial audio modeling and rendering
Dae Young Jang, Daejeon (KR); Kyeongok Kang, Daejeon (KR); Jae-hyoun Yoo, Daejeon (KR); and Yong Ju Lee, Daejeon (KR)
Assigned to ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, Daejeon (KR)
Filed by Electronics and Telecommunications Research Institute, Daejeon (KR)
Filed on Jan. 12, 2023, as Appl. No. 18/096,439.
Claims priority of application No. 10-2022-0005545 (KR), filed on Jan. 13, 2022; and application No. 10-2022-0161448 (KR), filed on Nov. 28, 2022.
Prior Publication US 2023/0224668 A1, Jul. 13, 2023
Int. Cl. H04S 7/00 (2006.01); G10L 19/008 (2013.01)
CPC H04S 7/304 (2013.01) [G10L 19/008 (2013.01); H04S 7/305 (2013.01); H04S 2400/13 (2013.01); H04S 2420/01 (2013.01)] 16 Claims
OG exemplary drawing
 
1. An apparatus for immersive spatial audio modeling and rendering, the apparatus comprising:
an acoustical space model representation unit configured to output a spatial audio model in response to receiving a visual space model and a spatial audio parameter;
a spatial audio modeling unit configured to analyze a spatial audio scene and output a spatial audio parameter in response to receiving the spatial audio model from the acoustical space model representation unit;
a spatial audio codec unit configured to generate a bitstream by encoding an audio source required for spatial audio rendering and the spatial audio parameter output from the spatial audio modeling unit and then transmit the generated bitstream, and perform a function of reconstructing the audio source and the spatial audio parameter by receiving and parsing the transmitted bitstream so as to render a spatial audio in real time;
a spatial audio processing unit configured to synthesize and output a room impulse response (RIR) by generating a direct sound, an early reflection, and a late reverberation according to an audio transfer pathway in response to receiving information on a position of a listener and the spatial audio parameter received from the spatial audio codec unit; and
a spatial audio reproduction unit configured to generate a spatial audio at the position of the listener and then reproduce the generated spatial audio in response to receiving the information on the position of the listener and the RIR from the spatial audio processing unit.