US 12,461,706 B2
Modifying a sound in a user environment in response to determining a shift in user attention
Nava K. Balsam, Woodinville, WA (US); Khia Johnson, Seattle, WA (US); Haniyeh Salehi, Statesville, NC (US); Ishwarya Ananthabhotla, Cambridge, MA (US); and Antje Ihlefeld, Redmond, WA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Mar. 16, 2023, as Appl. No. 18/122,371.
Prior Publication US 2024/0311076 A1, Sep. 19, 2024
Int. Cl. G06F 3/01 (2006.01); G06F 3/16 (2006.01); G06F 40/58 (2020.01); G10L 15/00 (2013.01); G10L 15/22 (2006.01); H04R 1/10 (2006.01)
CPC G06F 3/165 (2013.01) [G06F 3/013 (2013.01); G06F 40/58 (2020.01); G10L 15/005 (2013.01); G10L 15/22 (2013.01); H04R 1/1041 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
tracking, at an eye tracking system, a position and an orientation of each eye of a user of the eye tracking system;
determining a gaze point of the user based at least in part on the position and the orientation of each eye;
detecting, at an audio system coupled to the eye tracking system, a sound in an environment of the user;
detecting, at the eye tracking system, a change in the gaze point of the user;
determining whether an attention of the user has shifted based at least in part on applying a machine learning model to a set of attributes of the change in the gaze point of the user to predict a likelihood that the attention of the user has shifted;
determining whether the attention of the user has shifted based at least in part on the predicted likelihood that the attention of the user has shifted;
responsive to determining the attention of the user has shifted, modifying the sound at the audio system; and
communicating the modified sound to the user.