US 12,260,560 B1
Eye tracking based on fusing lens-aligned camera and light sensor data
Siddharth S. Hazra, Hayward, CA (US); Aleksandar M. Movshovich, Santa Clara, CA (US); Nicholas C. Soldner, Mountain View, CA (US); and Tushar Gupta, San Mateo, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Mar. 11, 2022, as Appl. No. 17/692,936.
Claims priority of provisional application 63/160,103, filed on Mar. 12, 2021.
Int. Cl. G06T 7/20 (2017.01); G02B 27/00 (2006.01); G06V 10/80 (2022.01)
CPC G06T 7/20 (2013.01) [G02B 27/0093 (2013.01); G06V 10/80 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A device comprising:
a camera comprising an image sensor configured to capture images at a first capture rate, wherein a center of the camera is at a center position of a cross section of the camera;
a light sensor separate from the image sensor, the light sensor configured to capture sensor data at a second capture rate, the second capture rate faster than the first capture rate, wherein the light sensor comprises one or more light sensor components in an arrangement centered around the center position such that the light sensor and camera are co-centered around the center position;
a lens positioned to direct a first portion of received light to the camera and a second portion of the received light to the light sensor;
a processor; and
a computer-readable storage medium comprising instructions that upon execution by the processor cause the device to track an eye based on the images captured by the camera and the sensor data captured by the light sensor.