US 12,346,495 B2
Tracking system using a differential camera with a co-aligned light source assembly
Robert Konrad Konrad, San Francisco, CA (US); Kevin Conlon Boyle, San Francisco, CA (US); Gordon Wetzstein, Palo Alto, CA (US); Nitish Padmanaban, Menlo Park, CA (US); and John Gabriel Buckmaster, San Jose, CA (US)
Assigned to Sesame AI, Inc., San Francisco, CA (US)
Filed by Sesame AI, Inc., San Francisco, CA (US)
Filed on Sep. 15, 2023, as Appl. No. 18/368,856.
Claims priority of provisional application 63/439,778, filed on Jan. 18, 2023.
Claims priority of provisional application 63/407,456, filed on Sep. 16, 2022.
Prior Publication US 2024/0094811 A1, Mar. 21, 2024
Int. Cl. G06F 3/01 (2006.01); G06T 7/20 (2017.01); G06V 10/141 (2022.01); G06V 10/60 (2022.01); G06V 40/18 (2022.01); H04N 23/611 (2023.01); H04N 23/71 (2023.01); H04N 23/74 (2023.01); H04N 23/90 (2023.01); H04N 25/47 (2023.01)
CPC G06F 3/013 (2013.01) [G06T 7/20 (2013.01); G06V 10/141 (2022.01); G06V 10/60 (2022.01); G06V 40/193 (2022.01); H04N 23/611 (2023.01); H04N 23/71 (2023.01); H04N 23/74 (2023.01); H04N 23/90 (2023.01); H04N 25/47 (2023.01)] 18 Claims
OG exemplary drawing
 
1. A co-aligned light source camera assembly (LSCA) comprising:
a light source configured to emit light that is directed along an optical path towards an eye box including an eye of a user;
a differential camera sensor configured to detect a change in brightness of the eye caused in part by the emitted light, and asynchronously output data samples corresponding to the detected change in brightness, wherein the optical path is substantially co-aligned with an optical path of the differential camera sensor;
an aperture in a sensor housing that is positioned between the differential camera sensor and the eye box; and
a second light source configured to emit one or more pulses of light along a second optical path towards the eye box, the second light source positioned adjacent to the aperture such that the one or more pulses of light are substantially co-aligned with the optical path of the differential camera sensor, and
wherein a controller is configured to:
identify a pupil of the eye based on data samples output from the differential camera sensor resulting from the emitted light, and
determine a gaze location of the user based in part on the identified pupil.