US 11,883,104 B2
Eye center of rotation determination, depth plane selection, and render camera positioning in display systems
Samuel A. Miller, Hollywood, FL (US); Lomesh Agarwal, Fremont, CA (US); Lionel Ernest Edwin, Hollywood, FL (US); Ivan Li Chuen Yeoh, Wesley Chapel, FL (US); Daniel Farmer, Verdi, NV (US); Sergey Fyodorovich Prokushkin, Campbell, CA (US); Yonatan Munk, Fort Lauderdale, FL (US); Edwin Joseph Selker, Palo Alto, CA (US); Bradley Vincent Stuart, Fort Lauderdale, FL (US); and Jeffrey Scott Sommers, Mountain View, CA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Sep. 2, 2021, as Appl. No. 17/465,715.
Application 17/465,715 is a continuation of application No. 16/250,931, filed on Jan. 17, 2019, granted, now 11,112,863.
Claims priority of provisional application 62/702,849, filed on Jul. 24, 2018.
Claims priority of provisional application 62/618,559, filed on Jan. 17, 2018.
Prior Publication US 2022/0057862 A1, Feb. 24, 2022
Int. Cl. A61B 3/113 (2006.01); G06F 3/01 (2006.01); A61B 3/11 (2006.01); G06V 40/18 (2022.01); H04N 13/383 (2018.01); H04N 13/344 (2018.01); G02B 30/40 (2020.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 3/04815 (2022.01); G06T 3/40 (2006.01); G06V 10/60 (2022.01)
CPC A61B 3/113 (2013.01) [A61B 3/111 (2013.01); G02B 27/0081 (2013.01); G02B 27/0093 (2013.01); G02B 27/0172 (2013.01); G02B 27/0176 (2013.01); G02B 30/40 (2020.01); G06F 3/013 (2013.01); G06F 3/04815 (2013.01); G06V 40/193 (2022.01); H04N 13/344 (2018.05); H04N 13/383 (2018.05); G02B 2027/0134 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0174 (2013.01); G06T 3/40 (2013.01); G06V 10/60 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A display system configured to project light to an eye of a user to display virtual image content in a vision field of said user, said eye having a cornea, an iris, a pupil, a lens, a retina, and an optical axis extending through said lens, pupil, and cornea, said display system comprising:
a frame configured to be supported on a head of the user;
a head-mounted display disposed on the frame, said display configured to project light into said user's eye to display virtual image content to the user's vision field, at least a portion of said display being transparent and disposed at a location in front of the user's eye when the user wears the frame such that said transparent portion transmits light from a portion of the environment in front of the user and said head-mounted display to the user's eye to provide a view of said portion of the environment in front of the user and said head-mounted display;
an inward-facing imaging system configured to image the user's eye; and
processing electronics in communication with the inward-facing imaging system, the processing electronics configured to obtain an estimate of a three-dimensional (3D) position of a center of rotation (CoR) of said eye based at least partly on a plurality of said eye images obtained with said inward-facing imaging system, wherein obtaining the estimate of the 3D position of the CoR includes:
determining a plurality of potential 3D positions of the CoR, wherein each potential 3D position of the CoR is determined as a particular distance from a center of an estimated corneal sphere that includes the cornea of the eye;
calculating a variation for each of the potential 3D positions of the CoR, wherein the variation is calculated based on an analysis of multiple images of the user's eye captured over a period of time; and
determining the estimate of the 3D position of the CoR as the potential 3D position that exhibits the lowest variation among the plurality of potential 3D positions.