CPC G06F 3/013 (2013.01) [G06F 18/214 (2023.01); G06T 5/002 (2013.01); G06T 5/009 (2013.01); G06V 10/82 (2022.01); G06V 40/00 (2022.01); G06V 40/18 (2022.01); G06F 18/241 (2023.01); G06V 40/19 (2022.01); G06V 40/193 (2022.01); G06V 40/197 (2022.01)] | 20 Claims |
1. A method for training a gaze tracking model, comprising:
obtaining a training sample set, the training sample set comprising multiple training sample pairs, each training sample pair comprising an eye sample image and a labeled gaze vector corresponding to the eye sample image;
processing the eye sample images in the training sample set by using an initial gaze tracking model to obtain a predicted gaze vector of each eye sample image;
determining a model loss according to a cosine distance between the predicted gaze vector and the labeled gaze vector for each eye sample image;
iteratively adjusting one or more reference parameters of the initial gaze tracking model until the model loss meets a convergence condition, to obtain a target gaze tracking model;
processing a target eye image by using the target gaze tracking model to determine a predicted gaze vector of the target eye image;
determining, when the target eye image belongs to a video frame in a video stream, a first and a second reference eye images corresponding to the target eye image, the first and the second reference eye images and the target eye image being images in consecutive video frames in the video stream; and
performing smoothing on the predicted gaze vector corresponding to the target eye image according to a predicted gaze vector corresponding to the first and the second reference eye images using a second-order Bezier curve.
|