CPC G06V 10/62 (2022.01) [G06F 3/011 (2013.01); G06F 3/013 (2013.01); G06V 10/462 (2022.01); G06V 40/193 (2022.01); H04N 7/147 (2013.01); H04N 7/15 (2013.01); H04N 13/344 (2018.05); H04N 13/117 (2018.05)] | 20 Claims |
1. A method of adjusting multi-view images of a head to correct gaze, the method comprising:
for each image, using a processor to identify image patches containing the left and right eyes of the head, respectively;
in respect of the image patches containing the left eyes of the head in each image of the multi-view images, and also in respect of the image patches containing the right eyes of the head in each image of the multi-view images, using the processor to perform the steps of:
deriving a feature vector from plural local image descriptors of the image patch in at least one image of the multi-view images; and
deriving a displacement vector field representing a transformation of an image patch, using the derived feature vector to look up reference data comprising reference displacement vector fields associated with possible values of the feature vector; and
adjusting each image of the multi-view images by transforming the image patches containing the left and right eyes of the head in accordance with the derived displacement vector field.
|