US 12,422,924 B2
Gaze depth-assisted encoding of region of interest in images
Mikko Strandborg, Helsinki (FI); Timo Toivanen, Helsinki (FI); and Mikko Ollila, Helsinki (FI)
Assigned to Varjo Technologies Oy, Helsinki (FI)
Filed by Varjo Technologies Oy, Helsinki (FI)
Filed on Nov. 9, 2023, as Appl. No. 18/505,680.
Prior Publication US 2025/0155970 A1, May 15, 2025
Int. Cl. G06F 3/01 (2006.01); G06T 7/50 (2017.01); G06T 9/00 (2006.01); G06T 15/00 (2011.01); G06V 10/25 (2022.01)
CPC G06F 3/013 (2013.01) [G06T 7/50 (2017.01); G06T 9/00 (2013.01); G06T 15/00 (2013.01); G06V 10/25 (2022.01); G06T 2207/10028 (2013.01)] 11 Claims
OG exemplary drawing
 
1. A system comprising at least one server configured to:
receive, from a client device, information indicative of gaze directions of a user's eyes;
determine a gaze point and a gaze depth of the user's eyes, using said information;
identify, in an image, a gaze-contingent region that includes and surrounds the gaze point;
identify a region of interest in the gaze-contingent region, wherein the region of interest comprises pixels whose optical depth lies within a first predefined distance (Δd1) from the gaze depth;
encode the image by applying a first encoding setting to the pixels belonging to the region of interest, wherein the first encoding setting comprises:
emphasis values indicative of a relative importance of the pixels belonging to the region of interest with respect to other pixels in the image, wherein the emphasis values are determined based on an emphasis curve that defines how emphasis values vary with respect to a distance of a given point from a three-dimensional position of the gaze point, and
a first compression ratio to be employed while encoding the pixels belonging to the region of interest, when the encoded image is to be transported by utilizing at least a portion of an entire bandwidth of a communication channel; and
send the image that is encoded, to the client device.