US 11,907,419 B2
Intelligent user interface element selection using eye-gaze
Narasimhan Raghunath, Redmond, WA (US); Austin B. Hodges, Seattle, WA (US); Fei Su, Sammamish, WA (US); Akhilesh Kaza, Sammamish, WA (US); Peter John Ansell, Seattle, WA (US); Jonathan T. Campbell, Redmond, WA (US); and Harish S. Kulkarni, Redmond, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Jun. 29, 2021, as Appl. No. 17/362,156.
Application 17/362,156 is a continuation of application No. 15/840,098, filed on Dec. 13, 2017, granted, now 11,073,904.
Claims priority of provisional application 62/537,434, filed on Jul. 26, 2017.
Prior Publication US 2021/0325962 A1, Oct. 21, 2021
Int. Cl. G06F 3/0481 (2022.01); G06F 3/0484 (2022.01); G06F 3/0488 (2022.01); G06F 3/01 (2006.01); G06F 3/04842 (2022.01); G06F 3/04886 (2022.01); G06F 40/274 (2020.01)
CPC G06F 3/013 (2013.01) [G06F 3/0481 (2013.01); G06F 3/04842 (2013.01); G06F 3/04886 (2013.01); G06F 40/274 (2020.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
a processor; and
memory coupled to the processor, the memory comprising computer executable instructions that, when executed by the processor, performs a method comprising:
receiving, within a user interface, a first series of gaze inputs associated with at least a first selection zone of a first UI element, wherein the first selection zone of the first UI element is assigned a first score;
assigning the first score to one or more gaze inputs in the first series of gaze inputs;
aggregating each first score assigned to the one or more gaze inputs in the first series of gaze inputs to calculate a first UI element score for the first UI element;
based on the first UI element score, performing an action response associated with the first UI element;
in response to the action response, using a predictive analysis algorithm to dynamically assign a second score to a first selection zone of a second UI element within the user interface, wherein dynamically assigning the second score to the first selection zone comprises:
identifying a previous or default score for the first selection zone of the second UI element; and
in response to determining, by the predictive analysis algorithm, that a second series of gaze inputs is likely to be directed toward the second UI element following the action response, increasing the previous or default score to the second score;
receiving, within the user interface, the second series of gaze inputs directed toward the first selection zone of the second UI element;
assigning the second score to one or more gaze inputs in the second series of gaze inputs; and
aggregating each second score assigned to the one or more gaze inputs in the second series of gaze inputs to calculate a second UI element score for the second UI element.