US 12,445,797 B2
Scalable binaural audio stream generation
Khoa-Van Nguyen, Begles (FR); Stephane Giraudie, Sausalito, CA (US); and Benoit Senard, Le Bouscat (FR)
Assigned to DOLBY LABORATORIES LICENSING CORPORATION, San Francisco, CA (US)
Filed by DOLBY LABORATORIES LICENSING CORPORATION, San Francisco, CA (US)
Filed on Mar. 7, 2022, as Appl. No. 17/688,554.
Application 17/688,554 is a continuation of application No. 16/554,904, filed on Aug. 29, 2019, granted, now 11,272,310.
Claims priority of provisional application 62/724,577, filed on Aug. 29, 2018.
Prior Publication US 2022/0191639 A1, Jun. 16, 2022
Int. Cl. H04S 7/00 (2006.01); H04R 3/04 (2006.01); H04R 5/033 (2006.01); H04R 5/04 (2006.01)
CPC H04S 7/304 (2013.01) [H04R 3/04 (2013.01); H04R 5/033 (2013.01); H04R 5/04 (2013.01); H04S 2400/11 (2013.01); H04S 2400/13 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method performed by a computing device for generating a binaural audio stream based on a virtual environment, the method comprising:
panning one or more audio streams of one or more sound sources to a set of virtual loudspeakers at respective virtual loudspeaker locations to yield a set of virtual loudspeaker audio streams, wherein each of the one or more sound sources is assigned to a different virtual source location in the virtual environment;
selecting a filtering mode among a predefined set of filtering modes based on a processing capability of the computing device;
determining, based on a relative position of each virtual source location to a virtual listener location in the virtual environment, filter parameters for a set of audio filters corresponding to the selected filtering mode;
performing a binaural audio filtering process on the set of virtual loudspeaker audio streams, using the set of audio filters and the determined filter parameters, to yield a set of individual binaural audio streams, based on relative positions of respective virtual loudspeaker locations to the virtual listener location; and
generating the binaural audio stream by combining one or more of the set of individual binaural audio streams, wherein the binaural audio stream is configured to enable a listener at the virtual listener location to perceive a sound from the one or more sound sources as emanating from respective virtual source locations.