US 12,273,504 B1
Gaze-assisted stereo reprojection
Mikko Strandborg, Helsinki (FI); and Ville Miettinen, Helsinki (FI)
Assigned to Varjo Technologies Oy, Helsinki (FI)
Filed by Varjo Technologies Oy, Helsinki (FI)
Filed on Oct. 5, 2023, as Appl. No. 18/481,268.
Int. Cl. H04N 13/383 (2018.01); H04N 13/156 (2018.01); H04N 13/398 (2018.01)
CPC H04N 13/383 (2018.05) [H04N 13/156 (2018.05); H04N 13/398 (2018.05)] 10 Claims
OG exemplary drawing
 
1. A display apparatus comprising:
gaze-tracking means;
at least one left light source and at least one right light source for a left eye and a right eye of a user, respectively; and
at least one processor configured to:
process gaze-tracking data, collected by the gaze-tracking means, to determine a left gaze direction and a right gaze direction of the left eye and the right eye, respectively;
send, to a server, information indicative of the left gaze direction and the right gaze direction;
receive, from the server, a left part of a left image and a right part of a right image, wherein a horizontal field of view (FOV) of the left part of the left image extends towards a right side of a gaze point of the left image till only a first predefined angle from the gaze point of the left image, while a horizontal FOV of the right part of the right image extends towards a left side of a gaze point of the right image till only a second predefined angle from the gaze point of the right image, the gaze point of the left image and the gaze point of the right image being determined based on the left gaze direction and the right gaze direction, respectively;
reconstruct a right part of the left image, by reprojecting a corresponding part of the right image;
reconstruct a left part of the right image, by reprojecting a corresponding part of the left image;
generate the left image, by combining the received left part and the reconstructed right part of the left image;
generate the right image, by combining the reconstructed left part and the received right part of the right image;
display the left image and the right image via the at least one left light source and the at least one right light source, respectively; and
receive, from the server, a lower-resolution copy of the right part of the left image,
wherein, when reconstructing the right part of the left image, the at least one processor is configured to:
detect at least one disocclusion area in the right part of the left image, when reprojecting the corresponding part of the right image to reconstruct the right part of the left image; and
utilise the lower-resolution copy of the right part of the left image to reconstruct the at least one disocclusion area in the right part of the left image.