US 12,487,667 B2
Corrected gaze direction and origin
Julia Benndorf, Mountain View, CA (US); Qichao Fan, San Francisco, CA (US); Julian K Shutzberg, San Francisco, CA (US); Paul A Lacey, Davie, FL (US); and Hua Gao, San Jose, CA (US)
Assigned to Apple, Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 19, 2023, as Appl. No. 18/470,359.
Claims priority of provisional application 63/376,946, filed on Sep. 23, 2022.
Prior Publication US 2024/0103618 A1, Mar. 28, 2024
Int. Cl. G09G 5/00 (2006.01); G06F 3/01 (2006.01); H04N 13/344 (2018.01)
CPC G06F 3/013 (2013.01) [H04N 13/344 (2018.05)] 20 Claims
OG exemplary drawing
 
1. A device, comprising:
a display configured to be positioned in front of an eye;
an eye-facing camera configured to capture images of the eye;
a lens configured to be between the eye and the display; and
a controller comprising one or more processors configured to:
obtain a model of the eye including an optical axis and an entrance pupil;
obtain one or more images of the eye captured when the eye is looking at a target prompt on the display;
determine, from the one or more images, a difference on the display between a gaze direction of the eye when looking at the target prompt and the optical axis of the model of the eye; and
determine a visual axis for the eye based on the determined difference and the model of the eye;
calculate a lens-corrected gaze axis by tracing a ray representing the visual axis through the lens according to optical characteristics of the lens; and
calculate a corrected entrance pupil by tracing one or more additional virtual rays through the lens according to the optical characteristics and determining an intersection of the one or more additional virtual rays with the ray representing the visual axis.