US 11,935,306 B2
Data collection apparatus for estimating emotion of a person watching vehicle
Ikuo Goto, Tokyo (JP); Terunori Kobayashi, Tokyo (JP); Kotaro Uki, Tokyo (JP); and Hideyuki Takao, Tokyo (JP)
Assigned to SUBARU CORPORATION, Tokyo (JP)
Filed by SUBARU CORPORATION, Tokyo (JP)
Filed on Jan. 15, 2021, as Appl. No. 17/150,431.
Claims priority of application No. 2020-039519 (JP), filed on Mar. 9, 2020.
Prior Publication US 2021/0279480 A1, Sep. 9, 2021
Int. Cl. G06V 40/16 (2022.01); G06F 16/245 (2019.01); G06V 20/56 (2022.01)
CPC G06V 20/56 (2022.01) [G06F 16/245 (2019.01); G06V 40/174 (2022.01)] 15 Claims
OG exemplary drawing
 
1. A data collection apparatus comprising a processor configured to:
detect a person who is watching an own vehicle from image data of a surrounding environment of the own vehicle;
calculate a degree of interest the person has in the own vehicle;
determine that the degree of interest is equal to or greater than a predetermined threshold;
in response to determining that the degree of interest is equal to or greater than the predetermined threshold, estimate, using Facial Action Coding System, an emotion of the person based on the image data;
generate emotion data including an estimate of the emotion of the person watching the own vehicle,
specify a state of the own vehicle viewed by the person, and
correlate the emotion data with the specified state of the own vehicle; and
in response correlating the emotion data with the specified state of the own vehicle, control a storage to store the emotion data correlated with the specified state of the own vehicle.