US 11,899,837 B2
Eye gaze tracking
Yingxuan Zhu, Cambridge, MA (US); Wenyou Sun, San Jose, CA (US); and Jian Li, Waltham, MA (US)
Assigned to Huawei Technologies Co., Ltd., Shenzhen (CN)
Filed by Huawei Technologies Co., Ltd., Shenzhen (CN)
Filed on Apr. 8, 2022, as Appl. No. 17/716,438.
Application 17/716,438 is a continuation of application No. PCT/US2019/055412, filed on Oct. 9, 2019.
Prior Publication US 2022/0229492 A1, Jul. 21, 2022
Int. Cl. G06F 3/01 (2006.01); G06T 7/68 (2017.01); G06V 40/16 (2022.01); G06F 3/14 (2006.01); G06V 10/42 (2022.01); G06V 10/143 (2022.01); G06V 40/19 (2022.01); G06V 40/18 (2022.01)
CPC G06F 3/013 (2013.01) [G06F 3/14 (2013.01); G06T 7/68 (2017.01); G06V 10/143 (2022.01); G06V 10/42 (2022.01); G06V 40/161 (2022.01); G06V 40/172 (2022.01); G06V 40/19 (2022.01); G06V 40/193 (2022.01); G06T 2207/10028 (2013.01)] 19 Claims
OG exemplary drawing
 
1. An apparatus for eye gaze tracking, the apparatus comprising:
a visible wavelength camera;
an infrared (IR) camera; and
one or more processors configured to:
generate a three-dimensional (3D) point cloud of a person's face from IR data captured from the IR camera;
generate a two-dimensional image of the person's face from visible wavelength data captured from the visible wavelength camera;
detect a symmetry plane of the person's face based on the 3D point cloud and the two-dimensional image, the symmetry plane divides the 3D point cloud into two portions including minimize a cost function to detect the symmetry plane, the cost function comprising a first parameter that provides a first weight for a first symmetrical half of the person's face and a second parameter that provides a second weight for a second symmetrical half of the person's face;
reconstruct the 3D point cloud based on the symmetry plane; and
detect and track eye gaze of the person's face based on the reconstructed 3D point cloud.