US 12,405,659 B2
Gaze timer based augmentation of functionality of a user input device
Karen Stolzenberg, Venice, CA (US); Marc Alan McCall, Plantation, FL (US); Frank Alexander Hamilton, IV, Martinsburg, WV (US); Cole Parker Heiner, Vista, CA (US); and John Austin Day, Miami, FL (US)
Assigned to MAGIC LEAP, INC., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Jun. 28, 2024, as Appl. No. 18/758,690.
Application 18/758,690 is a continuation of application No. 18/326,561, filed on May 31, 2023, granted, now 12,056,271.
Application 18/326,561 is a continuation of application No. 17/547,132, filed on Dec. 9, 2021, granted, now 11,703,943, issued on Jul. 18, 2023.
Application 17/547,132 is a continuation of application No. 17/135,352, filed on Dec. 28, 2020, granted, now 11,226,678, issued on Jan. 18, 2022.
Claims priority of provisional application 62/966,238, filed on Jan. 27, 2020.
Prior Publication US 2024/0353919 A1, Oct. 24, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/01 (2006.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 3/048 (2013.01); G06F 3/0482 (2013.01); G06F 3/023 (2006.01)
CPC G06F 3/011 (2013.01) [G02B 27/0093 (2013.01); G02B 27/0101 (2013.01); G02B 27/0172 (2013.01); G02B 27/0179 (2013.01); G06F 3/012 (2013.01); G06F 3/013 (2013.01); G06F 3/048 (2013.01); G06F 3/0482 (2013.01); G02B 27/01 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0187 (2013.01); G06F 3/017 (2013.01); G06F 3/023 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A computerized process performed under control of program instructions executed by one or more hardware processors, the process comprising:
detecting, based on sensor data collected during a mixed reality or augmented reality session, a gaze event in which a user gazes at, or within a defined region of, a physical object;
in response to detecting the gaze event, starting a timer used to measure whether a duration of the gaze event satisfies a condition for temporarily modifying functionality of a handheld controller; and
in response to determining that the duration of the gaze event satisfies the condition, modifying functionality of a user input element of the handheld controller, wherein modifying the functionality of the user input element comprises causing the user input element to be modified to a function that is not controllable via the handheld controller immediately before the gaze event,
wherein the physical object is a hand of the user, and
wherein the modifying the functionality of the user input element includes determining a first hand gesture or a second hand gesture of the hand of the user and causing the user input element to be modified with a first function upon the determination of the first hand gesture and with a second function upon the determination of the second hand gesture, the first function being different from the second function.