US 11,782,268 B2
Eyeball tracking system for near eye display apparatus, and near eye display apparatus
Hongen Ren, Shandong (CN); Bin Jiang, Shandong (CN); and Xiaoyu Chi, Shandong (CN)
Assigned to GOERTEK INC., Shandong (CN)
Appl. No. 17/602,839
Filed by GOERTEK INC., Shandong (CN)
PCT Filed Dec. 31, 2019, PCT No. PCT/CN2019/130252
§ 371(c)(1), (2) Date Oct. 11, 2021,
PCT Pub. No. WO2021/128406, PCT Pub. Date Jul. 1, 2021.
Claims priority of application No. 201911358389.6 (CN), filed on Dec. 25, 2019.
Prior Publication US 2022/0146824 A1, May 12, 2022
Int. Cl. G02B 27/00 (2006.01); G02B 27/01 (2006.01)
CPC G02B 27/0093 (2013.01) [G02B 27/0172 (2013.01); G02B 2027/0138 (2013.01)] 11 Claims
OG exemplary drawing
 
1. An eye tracking system for a near-eye display device, comprising:
a processor, a control analysis device, a light-emitting diode (LED) illuminating device, a digital micro-mirror display (DMD) display device and an infrared radiation (IR) camera, wherein
the processor is configured to output a video signal corresponding to a video currently displayed on the near-eye display device;
the control analysis device is configured to:
acquire, based on the video signal and a preset IR image signal, a multicolor image signal comprising the IR image signal;
generate an LED synchronization signal and a subfield display signal corresponding to the LED synchronization signal;
generate an acquisition signal when the LED synchronization signal and the subfield display signal both correspond to the IR image signal; and
acquire gaze point information based on an eye image captured by the IR camera;
the LED illuminating device is configured to drive an LED to emit light in response to the LED synchronization signal, and transmit the light emitted from the LED into the DMD display device, wherein the LED illuminating device comprises an LED module arranged in an optical machine, and the LED module comprises an IR LED;
the DMD display device is configured to reflect the light into a lens in response to the subfield display signal to form an image of a color, and project the image onto an eye through an optical waveguide mirror; and
the IR camera is configured to capture the eye image in response to the acquisition signal;
the LED illuminating device further comprises an LED driver, a dichroic mirror group and a homogenization system, wherein
the dichroic mirror group and the homogenization system are arranged in the optical machine, and the LED module further comprises an R LED, a G LED and a B LED;
the LED driver is configured to generate an LED drive signal in response to the LED synchronization signal, to drive the LED in the LED module to emit the light, and transmit the light into the homogenization system through the dichroic mirror group; and
the homogenization system is configured to convert the light into light with uniform brightness and transmit the converted light into the DMD display device;
the dichroic mirror group comprises a first dichroic mirror, a second dichroic mirror and a third dichroic mirror arranged in parallel, and
one of the B LED, the R LED, and the G LED shares an optical axis with the dichroic mirror group and the homogenization system, wherein
in a case where the B LED shares an optical axis with the dichroic mirror group and the homogenization system, blue light emitted from the B LED is transmitted into the homogenization system through the first dichroic mirror, the second dichroic mirror and the third dichroic mirror; green light emitted from the G LED is reflected by the first dichroic mirror and then transmitted into the homogenization system through the second dichroic mirror and the third dichroic mirror; red light emitted from the R LED is reflected by the second dichroic mirror and then transmitted into the homogenization system through the third dichroic mirror; and IR light emitted from the IR LED is reflected by the third dichroic mirror and then transmitted into the homogenization system;
in a case where the R LED shares an optical axis with the dichroic mirror group and the homogenization system, red light emitted from the R LED is transmitted into the homogenization system through the first dichroic mirror, the second dichroic mirror and the third dichroic mirror; green light emitted from the G LED is reflected by the first dichroic mirror and then transmitted into the homogenization system through the second dichroic mirror and the third dichroic mirror; blue light emitted from the B LED is reflected by the second dichroic mirror and then transmitted into the homogenization system through the third dichroic mirror; and IR light emitted from the IR LED is reflected by the third dichroic mirror and then transmitted into the homogenization system; and
in a case where the G LED shares an optical axis with the dichroic mirror group and the homogenization system, green light emitted from the G LED is transmitted into the homogenization system through the first dichroic mirror, the second dichroic mirror and the third dichroic mirror; blue light emitted from the B LED is reflected by the first dichroic mirror and then transmitted into the homogenization system through the second dichroic mirror and the third dichroic mirror; red light emitted from the R LED is reflected by the second dichroic mirror and then transmitted into the homogenization system through the third dichroic mirror; and IR light emitted from the IR LED is reflected by the third dichroic mirror and then transmitted into the homogenization system.