US 12,248,626 B2
Hybrid gaze tracking system
Walter Nistico, Redwood City, CA (US); and Patrick R. Gill, Victoria (CA)
Assigned to Apple Inc., Cupertino, CA (US)
Appl. No. 18/681,275
Filed by APPLE INC., Cupertino, CA (US)
PCT Filed Aug. 5, 2022, PCT No. PCT/US2022/039555
§ 371(c)(1), (2) Date Feb. 5, 2024,
PCT Pub. No. WO2023/027881, PCT Pub. Date Mar. 2, 2023.
Claims priority of provisional application 63/236,902, filed on Aug. 25, 2021.
Prior Publication US 2024/0353923 A1, Oct. 24, 2024
Int. Cl. G06F 3/01 (2006.01); G06V 40/18 (2022.01)
CPC G06F 3/013 (2013.01) [G06V 40/18 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising: at a device having one or more processors and one or more sensors,
detecting a first attribute of an eye using selectively enabled light-based measurements in a first image of the eye;
determining a first location associated with the first attribute in a three dimensional (3D) coordinate system based on first depth information;
detecting a second attribute of the eye based on second depth information from ultrasonic based measurements of the eye, wherein the ultrasonic based measurements selectively trigger the light-based measurements based on eye movements of the eye exceeding a threshold amount;
determining a second location associated with the second attribute in the 3D coordinate system based on the second depth information and a 3D model of a portion of the eye; and
determining a gaze direction in the 3D coordinate system based on the first location and the second location.