US 11,924,536 B2
Augmented reality device including variable focus lenses and operating method thereof
Kyookeun Lee, Suwon-si (KR); Bonkon Koo, Suwon-si (KR); Doyoun Kim, Suwon-si (KR); and Harry Edward Milton, Suwon-si (KR)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Jun. 22, 2022, as Appl. No. 17/846,810.
Application 17/846,810 is a continuation of application No. PCT/KR2022/008722, filed on Jun. 20, 2022.
Claims priority of application No. 10-2021-0081172 (KR), filed on Jun. 22, 2021; and application No. 10-2022-0021727 (KR), filed on Feb. 18, 2022.
Prior Publication US 2022/0404578 A1, Dec. 22, 2022
Int. Cl. G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06T 7/246 (2017.01); G06T 7/50 (2017.01); G06T 7/73 (2017.01); H04N 23/56 (2023.01)
CPC H04N 23/56 (2023.01) [G02B 27/0172 (2013.01); G02B 27/0179 (2013.01); G06F 3/013 (2013.01); G06T 7/246 (2017.01); G06T 7/50 (2017.01); G06T 7/73 (2017.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0178 (2013.01); G02B 2027/0187 (2013.01); G06T 2207/10048 (2013.01); G06T 2207/30201 (2013.01)] 15 Claims
OG exemplary drawing
 
1. An augmented reality device comprising:
a variable focus lens;
an eye tracking sensor comprising an infrared (IR) light source and an IR camera; and
at least one processor configured to:
control the IR light source of the eye tracking sensor to emit IR light to the eye of the user and obtain an image by controlling the IR camera of the eye tracking sensor to photograph the IR light reflected by the eye of the user,
detect a plurality of glint feature points from the obtained image,
determine eye relief, which is a distance between the eye of the user and the variable focus lens, based on a distance between the plurality of detected glint feature points,
obtain information with respect to a gaze point at which gaze direction of a left eye of the user and gaze direction of a right eye of the user converge, and an interpupillary distance which is a distance between a pupil of the left eye and a pupil of the right eye, based on the plurality of glint feature points, and
determine a position of a focal region of the variable focus lens based on the information with respect to the eye relief, the gaze point, and the interpupillary distance.