US 11,703,943 B2
Gaze timer based augmentation of functionality of a user input device
Karen Stolzenberg, Venice, CA (US); Marc Alan McCall, Plantation, FL (US); Frank Alexander Hamilton, IV, Martinsburg, WV (US); Cole Parker Heiner, Vista, CA (US); and John Austin Day, Miami, FL (US)
Assigned to MAGIC LEAP, INC., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Dec. 9, 2021, as Appl. No. 17/547,132.
Application 17/547,132 is a continuation of application No. 17/135,352, filed on Dec. 28, 2020, granted, now 11,226,678.
Claims priority of provisional application 62/966,238, filed on Jan. 27, 2020.
Prior Publication US 2022/0100266 A1, Mar. 31, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/01 (2006.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 3/0482 (2013.01)
CPC G06F 3/011 (2013.01) [G02B 27/0093 (2013.01); G02B 27/0101 (2013.01); G02B 27/0172 (2013.01); G02B 27/0179 (2013.01); G06F 3/0482 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0187 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A computerized process performed under control of program instructions executed by one or more hardware processors, the process comprising:
detecting, based on sensor data collected during a mixed reality or augmented reality session, a controller gaze event in which a user gazes at, or within a defined region of, a handheld controller;
in response to detecting the controller gaze event, starting a timer used to measure whether a duration of the controller gaze event satisfies a condition for temporarily modifying functionality of the handheld controller;
in response to determining that the duration of the controller gaze event satisfies the condition, modifying functionality of a user input element of the handheld controller, wherein the user input element is a button of the handheld controller, wherein modifying the functionality of the user input element comprises causing the user input element to be mapped to a function that is not controllable via the handheld controller immediately before the controller gaze event; and
after modifying the functionality of the user input element: detecting a button press event in which the button is pressed; and in response to detecting the button press event, restoring a prior function of the button.