US 11,726,560 B2
Eye tracking using eye odometers
Tom Sengelaub, San Francisco, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 15, 2020, as Appl. No. 17/21,912.
Claims priority of provisional application 62/902,329, filed on Sep. 18, 2019.
Prior Publication US 2021/0081039 A1, Mar. 18, 2021
Int. Cl. G06F 3/01 (2006.01); G02B 27/00 (2006.01); G06T 7/20 (2017.01); G02B 27/01 (2006.01); H04N 23/65 (2023.01); H04N 23/667 (2023.01)
CPC G06F 3/013 (2013.01) [G02B 27/0093 (2013.01); G02B 27/017 (2013.01); G06T 7/20 (2013.01); H04N 23/651 (2023.01); H04N 23/667 (2023.01); G02B 2027/0138 (2013.01); G02B 2027/0178 (2013.01); G06T 2207/10048 (2013.01); G06T 2207/30196 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A system, comprising:
a head-mounted device (HMD) configured to display visual content for viewing by a user, wherein the HMD comprises:
at least one camera configured to capture images of the user's eyes at a frame rate; and
one or more eye motion sensors configured to detect movement of the user's eyes with respect to the HMD; and
a controller comprising one or more processors configured to:
process images captured by the at least one camera to generate or update one or more 3-dimentional (3D) models of the user's eyes to determine position of the user's eyes with respect to the HMD at the frame rate of the at least one camera; and
provide a relative update to the 3D models of the user's eyes based on processing of signals from the one or more eye motion sensors to update the position of the user's eyes with respect to the HMD that is determined based on the images captured by the at least one camera, in intervals between the processing of images captured by the at least one camera.