US 12,238,495 B2
Eyewear with audio source separation using pose trackers
Georgios Evangelidis, Vienna (AT); Ashwani Arya, Cypress, CA (US); Jennica Pounds, Bellevue, WA (US); and Andrei Rybin, Lehi, UT (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Georgios Evangelidis, Vienna (AT); Ashwani Arya, Cypress, CA (US); Jennica Pounds, Bellevue, WA (US); and Andrei Rybin, Lehi, UT (US)
Filed on Apr. 1, 2022, as Appl. No. 17/711,494.
Prior Publication US 2023/0319476 A1, Oct. 5, 2023
Int. Cl. H04R 5/04 (2006.01); G02C 11/00 (2006.01); G06F 3/01 (2006.01); G06F 3/16 (2006.01); H04R 1/10 (2006.01); H04R 5/027 (2006.01)
CPC H04R 5/04 (2013.01) [G02C 11/10 (2013.01); G06F 3/012 (2013.01); G06F 3/165 (2013.01); H04R 1/105 (2013.01); H04R 1/1091 (2013.01); H04R 5/027 (2013.01)] 20 Claims
OG exemplary drawing
 
1. Electronic eyewear device, comprising:
an inertial measurement unit (IMU);
a pose tracker;
a microphone array configured to receive sounds from audio sources in an environment and generate audio signals;
a head-mounting frame that supports the IMU, the pose tracker, and the microphone array; and
a processor configured to:
generate a trajectory of the electronic eyewear device worn by a user using the pose tracker;
determine a trajectory of a remote electronic eyewear device worn by another user by identifying a fixed point on a symmetry plane of a face of the other user;
align the trajectory of the pose tracker with the trajectory of the remote electronic eyewear device;
determine a location of the remote electronic eyewear device from the determined trajectory;
unmix the received sounds based on the determined location of the remote electronic eyewear device; and
enable the user to select a desired direction to isolate the sounds by interacting with the electronic eyewear device.