US 12,226,211 B2
Attentiveness determination device, attentiveness determination system, attentiveness determination method, and computer-readable storage medium
Daichi Tsunemichi, Tokyo (JP)
Assigned to MITSUBISHI ELECTRIC CORPORATION, Tokyo (JP)
Appl. No. 17/421,736
Filed by Mitsubishi Electric Corporation, Tokyo (JP)
PCT Filed Jan. 21, 2019, PCT No. PCT/JP2019/001586
§ 371(c)(1), (2) Date Jul. 9, 2021,
PCT Pub. No. WO2020/152732, PCT Pub. Date Jul. 30, 2020.
Prior Publication US 2022/0095972 A1, Mar. 31, 2022
Int. Cl. A61B 5/16 (2006.01); A61B 3/08 (2006.01); A61B 3/11 (2006.01); A61B 3/113 (2006.01); A61B 3/14 (2006.01); G06T 7/70 (2017.01); G06V 40/16 (2022.01); G06V 40/18 (2022.01)
CPC A61B 5/163 (2017.08) [A61B 3/085 (2013.01); A61B 3/111 (2013.01); A61B 3/113 (2013.01); A61B 3/14 (2013.01); A61B 5/168 (2013.01); G06T 7/70 (2017.01); G06V 40/161 (2022.01); G06V 40/18 (2022.01); G06T 2207/30041 (2013.01)] 14 Claims
OG exemplary drawing
 
1. An attentiveness determination device to use a captured image including a first eyeball and a second eyeball of a person, comprising:
a processor to execute a program; and
a memory to store the program which, when executed by the processor, performs processes of,
setting first reference coordinates regarding the first eyeball and second reference coordinates regarding the second eyeball in the captured image, calculating first pupil coordinates that are coordinates of a pupil of the first eyeball in the captured image and second pupil coordinates that are coordinates of a pupil of the second eyeball in the captured image, and outputting the first reference coordinates, the second reference coordinates, the first pupil coordinates, and the second pupil coordinates;
calculating at least one position component of the first pupil coordinates with respect to the first reference coordinates and at least one position component of the second pupil coordinates with respect to the second reference coordinates;
outputting a heterophoria detection result indicating a state of the first eyeball and the second eyeball by using the at least one position component of the first pupil coordinates and the at least one position component of the second pupil coordinates; and
determining attentiveness of the person according to the heterophoria detection result.