US 12,106,734 B1
Hiding lens distortions using black pixels
Mikko Strandborg, Hangonkylä (FI); and Antti Hirvonen, Espoo (FI)
Assigned to Varjo Technologies Oy, Helsinki (FI)
Filed by Varjo Technologies Oy, Helsinki (FI)
Filed on Nov. 20, 2023, as Appl. No. 18/513,723.
Int. Cl. G06T 5/80 (2024.01); G06F 3/01 (2006.01); G09G 5/10 (2006.01)
CPC G09G 5/10 (2013.01) [G06F 3/013 (2013.01); G06T 5/80 (2024.01); G09G 2320/0626 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A display apparatus comprising:
gaze-tracking means;
at least one light source;
an eyepiece lens arranged on an optical path of the at least one light source; and
at least one processor configured to:
process gaze-tracking data, collected by the gaze-tracking means, to determine a gaze direction of a given eye of a user;
determine a relative position of a pupil of the given eye with respect to the eyepiece lens and a relative orientation of the pupil of the given eye with respect to an optical axis of the eyepiece lens, based on at least one of: the gaze-tracking data, the gaze direction of the given eye;
estimate distortions per pixel or per group of pixels in an image, based on the relative position of the pupil, the relative orientation of the pupil and distortion information indicative of distortion caused by the eyepiece lens;
identify an image segment whose pixels' or groups of pixels' estimated distortions are higher than a predefined threshold distortion;
modify the image by replacing the pixels of the identified image segment with black pixels or near-black pixels; and
utilise the modified image for display to the given eye via the at least one light source.