US 11,789,530 B2
Gaze-based user interface with assistant features for smart glasses in immersive reality applications
Sebastian Sztuk, Virum (DK); and Salvael Ortega Estrada, Cedar Park, TX (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Sep. 22, 2022, as Appl. No. 17/950,959.
Claims priority of provisional application 63/318,651, filed on Mar. 10, 2022.
Claims priority of provisional application 63/280,515, filed on Nov. 17, 2021.
Prior Publication US 2023/0152886 A1, May 18, 2023
Int. Cl. G06F 3/01 (2006.01); G06F 3/04817 (2022.01); G06F 9/451 (2018.01); G06F 3/16 (2006.01); H04M 1/72469 (2021.01); G06F 3/0485 (2022.01)
CPC G06F 3/013 (2013.01) [G06F 3/017 (2013.01); G06F 3/0485 (2013.01); G06F 3/04817 (2013.01); G06F 3/167 (2013.01); G06F 9/453 (2018.02); H04M 1/72469 (2021.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
identifying an eye gesture of a user of a headset, based on an eye-tracking signal indicative of a pupil location of the user;
assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture;
activating the application based on the user intention;
identifying, in the user interface in the headset, an object of the user intention; and
displaying, on at least one eyepiece of the headset, a virtual assistant to verbally interact with and point out to the user, an attribute of the object of the user intention that is relevant to the user.