US 11,792,597 B2
Gaze-based audio beamforming
Dongeek Shin, Santa Clara, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Nov. 22, 2021, as Appl. No. 17/456,007.
Prior Publication US 2023/0164508 A1, May 25, 2023
Int. Cl. H04S 7/00 (2006.01); G06T 7/70 (2017.01); G06F 3/01 (2006.01); H04R 1/40 (2006.01)
CPC H04S 7/303 (2013.01) [G06F 3/013 (2013.01); G06T 7/70 (2017.01); H04R 1/406 (2013.01); G06T 2207/30201 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method comprising:
receiving audio channels from a plurality of microphones of an augmented reality (AR) device, the plurality of microphones configured to operate as a microphone array;
tracking an eye of a user of the AR device to determine a gaze direction of the user;
selecting a beam pattern for the microphone array, the beam pattern selected from a set of stored beam patterns based on the gaze direction of the user;
generating a beamformed audio signal based on the selected beam pattern; and
transmitting the beamformed audio signal to speakers of the AR device for playing the beamformed audio signal to the user.