US 12,394,246 B2
Emotion determination device and emotion determination method
Ayana Tsuji, Kyoto (JP); Takashi Ohta, Kyoto (JP); Kazuya Urabe, Kyoto (JP); and Tatsuki Sawada, Kyoto (JP)
Assigned to OMRON CORPORATION, Kyoto (JP)
Appl. No. 18/000,204
Filed by OMRON Corporation, Kyoto (JP)
PCT Filed May 19, 2021, PCT No. PCT/JP2021/019006
§ 371(c)(1), (2) Date Nov. 29, 2022,
PCT Pub. No. WO2021/261126, PCT Pub. Date Dec. 30, 2021.
Claims priority of application No. 2020-108400 (JP), filed on Jun. 24, 2020.
Prior Publication US 2023/0206691 A1, Jun. 29, 2023
Int. Cl. G06V 40/16 (2022.01); G06V 10/80 (2022.01); H04N 23/23 (2023.01)
CPC G06V 40/176 (2022.01) [G06V 10/80 (2022.01); H04N 23/23 (2023.01)] 11 Claims
OG exemplary drawing
 
1. An emotion determination device, comprising:
a memory configured to store computer-executable instructions; and
a processor configured to execute the computer-executable instructions stored in the memory to implement:
a first estimator configured to estimate an emotion of a user based on a change in a facial expression of the user detected from a face image of the user;
a second estimator configured to estimate the emotion of the user based on a change in a temperature of the user detected contactlessly from the user;
a determiner configured to determine the emotion of the user based on an estimation result obtained by the first estimator and an estimation result obtained by the second estimator; and
an adjuster configured to detect a period with a variance value, for the period up to a predetermined time, of scores indicating a likelihood of the user holding an estimated emotion being less than a predetermined threshold value and adjust the estimation result obtained by the first estimator and the estimation result obtained by the second estimator to replace an estimation result from a first period with the variance value less than the predetermined threshold value backward up to a period immediately after a second period with the variance value less than the predetermined threshold value with an estimation result in the first period,
wherein the determiner determines the emotion of the user based on the adjusted estimation result obtained by the adjuster.