US 12,366,916 B2
Method and system for determining a current gaze direction
Denny Rönngren, Danderyd (SE)
Assigned to Tobii AB, Danderyd (SE)
Filed by Tobii AB, Danderyd (SE)
Filed on Dec. 23, 2022, as Appl. No. 18/146,215.
Claims priority of application No. 2151638-0 (SE), filed on Dec. 30, 2021.
Prior Publication US 2023/0214011 A1, Jul. 6, 2023
Int. Cl. G06T 19/20 (2011.01); G06F 3/01 (2006.01); G06T 15/20 (2011.01); G06V 20/64 (2022.01)
CPC G06F 3/013 (2013.01) [G06T 19/20 (2013.01); G06T 2219/2016 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method in a system for determining a current gaze direction of a user in relation to a three-dimensional (“3D”) scene, the 3D scene being sampled by a rendering function executed on a graphic processing unit (GPU) to produce at least one projection image of the 3D scene, wherein the method comprises the steps:
determining, by a reprojection means executed on a central processing unit (CPU), a reprojection transformation to be applied to the projection image before the projection image being visibly displayed to the user at a gaze time point;
determining, by a gaze direction detection means executed by an eye-tracking device, a gaze direction of the user at said gaze time point;
determining, by a modified gaze direction detection means executed on the CPU, a modified gaze direction of the user at said gaze time point, the modified gaze direction being determined in relation to the 3D scene based on both the user's gaze direction and the reprojection transformation and
setting, by the modified gaze direction detection means, a current gaze direction in relation to the 3D scene as the modified gaze direction of the user.