US 12,339,458 B2
Periocular test for mixed reality calibration
Adrian Kaehler, Los Angeles, CA (US); Gary Bradski, Palo Alto, CA (US); and Vijay Badrinarayanan, Mountain View, CA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Dec. 29, 2023, as Appl. No. 18/401,020.
Application 18/401,020 is a continuation of application No. 17/385,724, filed on Jul. 26, 2021, granted, now 11,906,742.
Application 17/385,724 is a continuation of application No. 16/780,698, filed on Feb. 3, 2020, granted, now 11,100,692, issued on Aug. 24, 2021.
Application 16/780,698 is a continuation of application No. 15/717,747, filed on Sep. 27, 2017, granted, now 10,573,042, issued on Feb. 25, 2020.
Claims priority of provisional application 62/416,341, filed on Nov. 2, 2016.
Claims priority of provisional application 62/404,419, filed on Oct. 5, 2016.
Claims priority of provisional application 62/404,493, filed on Oct. 5, 2016.
Prior Publication US 2024/0134200 A1, Apr. 25, 2024
Int. Cl. G02B 27/01 (2006.01); G06T 3/20 (2006.01); G06T 11/60 (2006.01); G06V 10/46 (2022.01); G06V 20/20 (2022.01); G06V 40/16 (2022.01); G06V 40/18 (2022.01); G06V 40/19 (2022.01)
CPC G02B 27/0172 (2013.01) [G02B 27/0179 (2013.01); G06T 3/20 (2013.01); G06T 11/60 (2013.01); G06V 10/462 (2022.01); G06V 20/20 (2022.01); G06V 40/165 (2022.01); G06V 40/166 (2022.01); G06V 40/171 (2022.01); G06V 40/19 (2022.01); G06V 40/193 (2022.01); G06V 40/197 (2022.01); G02B 2027/0127 (2013.01); G02B 2027/0134 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0178 (2013.01); G02B 2027/0181 (2013.01); G02B 2027/0187 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A head-mounted device (HMD) comprising:
one or more inward-facing cameras; and
a hardware processor programmed to periodically adjust a rendering location of a virtual object to be presented by the HMD, including:
receiving one or more images of a periocular region of a face of a user of the HMD, the one or more images captured by the one or more inward-facing cameras;
calculating a plurality of fit parameters based on an appearance of the periocular region of the user in the one or more images, wherein the plurality of fit parameters include: i) at least one distance between the HMD and the face, and ii) an interpupillary distance (IPD) between pupils of a first eye and a second eye of the user;
determining a relative position between the HMD and the face based at least partly on the plurality of fit parameters;
adjusting the rendering location of the virtual object based, at least in part, on the relative position between the HMD and the face exceeding a predetermined threshold amount, including determining that the IPD that is calculated based on the appearance of the periocular region is outside a threshold range of acceptable IPD, wherein the threshold range of acceptable IPD is calculated based on sampled IPD measurements of a group of people that share at least one common characteristic with the user; and
causing the HMD to render the virtual object at the adjusted rendering location.