CPC G06F 3/013 (2013.01) [G06F 3/012 (2013.01); G06N 3/084 (2013.01); G06T 7/74 (2017.01); G06V 10/25 (2022.01); G06N 3/045 (2023.01)] | 19 Claims |
1. A method to determine a target point of regard associated with a user of a display, the method comprising:
receiving a target image data associated with the user from a camera coupled with the display, wherein the target image data includes a target eye patch image data associated with the user and target head region image data;
determining, using a convolutional neural network, the target point of regard associated with the target image data based on:
the target eye patch image data,
a plurality of aggregated gaze reference vectors, and
a plurality of reference image data associated with the user, the plurality of reference image data respectively associated with the plurality of aggregated gaze reference vectors, one or more of the plurality of reference image data each including reference head region image data;
determining a target 6D head position associated with the target head region image data;
determining a reference 6D head position associated with the reference head region image data;
determining a target 3D eye position associated with the target eye patch image data;
wherein the target point of regard is determined within a predetermined threshold; and
mapping the target point of regard onto the display.
|