US 12,254,131 B1
Gaze-adaptive image reprojection
Mikko Strandborg, Helsinki (FI); and Urho Konttori, Helsinki (FI)
Assigned to Varjo Technologies Oy, Helsinki (FI)
Filed by Varjo Technologies Oy, Helsinki (FI)
Filed on Aug. 29, 2023, as Appl. No. 18/457,699.
Int. Cl. G06F 3/01 (2006.01); G06T 15/20 (2011.01); G06T 19/00 (2011.01)
CPC G06F 3/013 (2013.01) [G06F 3/012 (2013.01); G06T 15/20 (2013.01); G06T 19/006 (2013.01)] 13 Claims
OG exemplary drawing
 
1. An imaging system of a display apparatus comprising:
gaze-tracking means; and
at least one processor configured to:
process gaze-tracking data, collected by the gaze-tracking means, to detect gaze directions of a user's eyes;
determine a gaze convergence distance, based on a convergence of the gaze directions of the user's eyes;
identify a region of interest in a given image frame, based on a gaze direction of a given eye of the user from a perspective of which the given image frame is rendered; and
generate a reprojected image frame, by reprojecting the region of interest using six degrees-of-freedom (6DOF) reprojection, whilst considering the gaze convergence distance as an optical depth of pixels of the region of interest;
wherein when generating the reprojected image frame, the at least one processor is configured to reproject a peripheral region of the given image frame using three degrees-of-freedom (3DOF) reprojection, the peripheral region surrounding the region of interest.