US 11,895,479 B2
Steering of binauralization of audio
Qingyuan Bin, Beijing (CN); Libin Luo, Beijing (CN); Ziyu Yang, Beijing (CN); Zhiwei Shuang, Beijing (CN); Xuemei Yu, Beijing (CN); and Guiping Wang, Beijing (CN)
Assigned to Dolby Laboratories Licensing Corporation, San Francisco, CA (US)
Appl. No. 17/637,446
Filed by Dolby Laboratories Licensing Corporation, San Francisco, CA (US)
PCT Filed Aug. 19, 2020, PCT No. PCT/US2020/047079
§ 371(c)(1), (2) Date Feb. 22, 2022,
PCT Pub. No. WO2021/034983, PCT Pub. Date Feb. 25, 2021.
Claims priority of provisional application 62/956,424, filed on Jan. 2, 2020.
Claims priority of provisional application 62/896,321, filed on Sep. 5, 2019.
Claims priority of application No. PCT/CN2019/101291 (WO), filed on Aug. 19, 2019; and application No. 19218142 (EP), filed on Dec. 19, 2019.
Prior Publication US 2022/0279300 A1, Sep. 1, 2022
Int. Cl. H04S 7/00 (2006.01)
CPC H04S 7/30 (2013.01) [H04S 2420/01 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method for steering binauralization of audio, the method comprising steps of:
receiving an audio input signal, the audio input signal comprising a plurality of audio frames;
calculating a confidence value indicating a likelihood that a current audio frame of the audio input signal comprises binauralized audio;
determining a state signal based on the confidence value, the state signal indicating that the current audio frame being in an un-binauralized state or in a binauralized state;
determining a steering signal, wherein, upon the state signal being changed from indicating the un-binauralized state to indicating the binauralized state:
changing the steering signal to activate binauralization of audio by applying a head related transfer function, HRTF, on the audio input signal resulting in a binauralized audio signal, and
generating an audio output signal, at least partly comprising the binauralized audio signal;
wherein, upon the state signal being changed from indicating the binauralized state to indicating the un-binauralized state, setting a deactivation mode of binauralization to true; and
upon the deactivation mode of the binauralization being true, and the confidence value of the current audio frame being below a deactivation threshold, and an energy value of the current audio frame being lower than energy values of a threshold number of audio frames of the audio input signal previous to the current audio frame:
setting the deactivation mode of the binauralization to false,
changing the steering signal to deactivate or reduce binauralization of audio, and
generating the audio output signal at least partly comprising the audio input signal.