US 11,854,171 B2
Compensation for deformation in head mounted display systems
Lionel Ernest Edwin, Plantation, FL (US); Samuel A. Miller, Hollywood, FL (US); Etienne Gregoire Grossmann, Menlo Park, CA (US); Brian Christopher Clark, Palo Alto, CA (US); Michael Robert Johnson, Plantation, FL (US); Wenyi Zhao, Weston, FL (US); Nukul Sanjay Shah, Plantation, FL (US); and Po-Kang Huang, Sunnyvale, CA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Dec. 3, 2021, as Appl. No. 17/457,547.
Application 17/457,547 is a continuation of application No. 17/129,645, filed on Dec. 21, 2020, granted, now 11,200,646.
Claims priority of provisional application 63/044,165, filed on Jun. 25, 2020.
Claims priority of provisional application 62/961,630, filed on Jan. 15, 2020.
Prior Publication US 2022/0092747 A1, Mar. 24, 2022
Int. Cl. G06T 5/00 (2006.01); G06T 3/00 (2006.01); H04N 13/344 (2018.01); G02B 27/01 (2006.01); H04N 23/54 (2023.01)
CPC G06T 5/006 (2013.01) [G02B 27/0172 (2013.01); G06T 3/0068 (2013.01); H04N 13/344 (2018.05); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0178 (2013.01); G06T 2207/10024 (2013.01); H04N 23/54 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
maintaining first data for a first target image associated with an undeformed state of a first eyepiece of a head-mounted display device and second data for a first image for presentation by a first projector that is i) included in and optically coupled to the first eyepiece and ii) part of the head-mounted display device;
receiving, from a first temperature sensor that is coupled to a first imaging sensor of the first eyepiece and is part of the head-mounted display device, a first temperature measurement of the first imaging sensor;
determining a first transformation that maps the first image to the first target image and that accounts for a position of the first imaging sensor with respect to the first eyepiece using, at least in part, the first temperature measurement of the first imaging sensor; and
applying, to generate a transformed subsequent image, the first transformation to a subsequent image for presentation, by the first projector, onto the first eyepiece of the head-mounted display device.