US 12,444,237 B2
Synthetic gaze enrollment
Rene Heideklang, Neuenhagen bei Berlin (DE); Hua Gao, San Jose, CA (US); Hao Qin, Saratoga, CA (US); and Tom Sengelaub, Oakland, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 19, 2023, as Appl. No. 18/470,364.
Claims priority of provisional application 63/376,935, filed on Sep. 23, 2022.
Prior Publication US 2024/0104967 A1, Mar. 28, 2024
Int. Cl. G06V 40/50 (2022.01); G06F 3/01 (2006.01); G06T 7/70 (2017.01); G06V 40/19 (2022.01); H04L 9/08 (2006.01)
CPC G06V 40/50 (2022.01) [G06F 3/013 (2013.01); G06T 7/70 (2017.01); G06V 40/19 (2022.01); H04L 9/0866 (2013.01); G06T 2207/30201 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A device, comprising:
a display configured to be positioned in front of an eye;
an eye-facing camera configured to capture images of the eye; and
a controller comprising one or more processors configured to:
generate a multidimensional personalized model of the eye based on images captured by the eye-facing camera;
generate synthetic gaze features for the personalized model at ground-truth eye poses;
estimate synthetic eye poses from the synthetic gaze features using an average eye model; and
generate a gaze correction function from the ground-truth eye poses and the synthetic eye poses, wherein the gaze correction function represents differences between the ground-truth eye poses at the display and the synthetic eye poses at the display.