US 12,102,388 B2
Eye center of rotation determination, depth plane selection, and render camera positioning in display systems
Samuel A. Miller, Hollywood, FL (US); Lomesh Agarwal, Fremont, CA (US); Lionel Ernest Edwin, Hollywood, FL (US); Ivan Li Chuen Yeoh, Wesley Chapel, FL (US); Daniel Farmer, Verdi, NV (US); Sergey Fyodorovich Prokushkin, Campbell, CA (US); Yonatan Munk, Fort Lauderdale, FL (US); Edwin Joseph Selker, Palo Alto, CA (US); Bradley Vincent Stuart, Fort Lauderdale, FL (US); and Jeffrey Scott Sommers, Mountain View, CA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Dec. 7, 2023, as Appl. No. 18/532,448.
Application 18/532,448 is a continuation of application No. 17/465,715, filed on Sep. 2, 2021, granted, now 11,883,104.
Application 17/465,715 is a continuation of application No. 16/250,931, filed on Jan. 17, 2019, granted, now 11,112,863, issued on Sep. 7, 2021.
Claims priority of provisional application 62/702,849, filed on Jul. 24, 2018.
Claims priority of provisional application 62/618,559, filed on Jan. 17, 2018.
Prior Publication US 2024/0108217 A1, Apr. 4, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. A61B 3/113 (2006.01); A61B 3/11 (2006.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G02B 30/40 (2020.01); G06F 3/01 (2006.01); G06F 3/04815 (2022.01); G06V 40/18 (2022.01); H04N 13/344 (2018.01); H04N 13/383 (2018.01); G06T 3/40 (2006.01); G06V 10/60 (2022.01)
CPC A61B 3/113 (2013.01) [A61B 3/111 (2013.01); G02B 27/0081 (2013.01); G02B 27/0093 (2013.01); G02B 27/0172 (2013.01); G02B 27/0176 (2013.01); G02B 30/40 (2020.01); G06F 3/013 (2013.01); G06F 3/04815 (2013.01); G06V 40/193 (2022.01); H04N 13/344 (2018.05); H04N 13/383 (2018.05); G02B 2027/0134 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0174 (2013.01); G06T 3/40 (2013.01); G06V 10/60 (2022.01)] 17 Claims
OG exemplary drawing
 
1. A display system configured to project light to an eye of a user to display virtual image content in a vision field of said user, said eye having a cornea, an iris, a pupil, a lens, a retina, and an optical axis extending through said lens, pupil, and cornea, said display system comprising:
a frame configured to be supported on a head of the user;
a head-mounted display disposed on the frame, said display configured to project light into said user's eye to display virtual image content to the user's vision field at different amounts of at least one of divergence and collimation and thus the displayed virtual image content appears to originate from different depths at different periods of time;
one or more eye tracking cameras configured to image the user's eye; and
processing electronics in communication with the display and the one or more eye tracking cameras, the processing electronics configured to obtain an estimate of a center of rotation of said eye based on images of said eye obtained with said one or more eye tracking cameras, wherein said processing electronics is configured to use a render camera configured to render the virtual image content to said eye as if the virtual image content is captured by the render camera having an aperture that is positioned along the optical axis between the center of rotation of the eye and a center of the pupil of the eye, wherein the aperture of the render camera is positioned at a location along the optical axis that is closer to said center of rotation than said retina of said eye, wherein the estimate of the center of rotation of said eye is based on eye tracking data determined based on the images of said eye, and wherein the aperture of the render camera is positioned along the optical axis based on a standard deviation of the eye tracking data.