US 11,748,906 B2
Gaze point calculation method, apparatus and device
Feng Lu, Beijing (CN); and Mingfei Jiang, Beijing (CN)
Assigned to BEIHANG UNIVERSITY, Beijing (CN)
Filed by BEIHANG UNIVERSITY, Beijing (CN)
Filed on Nov. 30, 2020, as Appl. No. 17/107,817.
Claims priority of application No. 202010456584.9 (CN), filed on May 26, 2020.
Prior Publication US 2021/0374994 A1, Dec. 2, 2021
Int. Cl. G06F 3/01 (2006.01); G06T 17/00 (2006.01); G06V 40/16 (2022.01); G06T 7/70 (2017.01); G06T 7/73 (2017.01); G06T 7/50 (2017.01); H04N 23/698 (2023.01)
CPC G06T 7/75 (2017.01) [G06F 3/013 (2013.01); G06T 7/50 (2017.01); G06T 17/00 (2013.01); G06V 40/161 (2022.01); H04N 23/698 (2023.01); G06T 2207/30201 (2013.01)] 10 Claims
OG exemplary drawing
 
1. A gaze point calculation method, comprising:
determining a 3D model of a first scene;
obtaining a first panoramic image captured in the first scene, wherein a face image of a face is a part of the first panoramic image;
determining a spatial location of the face according to the first panoramic image;
determining a gaze direction corresponding to the face according to the first panoramic image; and
determining an eye gaze target according to the 3D model, the spatial location and the gaze direction,
wherein the determining the spatial location of the face according to the first panoramic image comprises:
determining angular coordinates of the face relative to a first photographing device, wherein the first photographing device is a device that captures the first panoramic image;
determining a radial distance of the face relative to the first photographing device; and
determining the spatial location according to the angular coordinates and the radial distance;
wherein the determining the eye gaze target according to the 3D model, the spatial location and the gaze direction comprises:
determining an eye gaze area in the 3D model according to the 3D model, the spatial location and the gaze direction; and
determining the eye gaze target according to the eye gaze area;
wherein the determining the eye gaze target according to the eye gaze area comprises:
determining distribution densities corresponding to each sub-area of the eye gaze area, wherein the distribution densities are used to indicate distribution densities of gaze points in the eye gaze area; and
determining the eye gaze target according to the distribution densities and objects included in the 3D model.