US 12,136,227 B2
Communication support device, communication support method, and computer-readable storage medium including program
Endri Rama, Kyoto (JP); Kazuo Yamamoto, Nara-shi (JP); Tomohiro Yabuuchi, Kyoto-shi (JP); and Naoto Iwamoto, Higashiosaka-shi (JP)
Assigned to OMRON CORPORATION, Kyoto (JP)
Filed by OMRON Corporation, Kyoto-shi (JP)
Filed on Aug. 2, 2021, as Appl. No. 17/391,624.
Claims priority of application No. 2020-131398 (JP), filed on Aug. 3, 2020.
Prior Publication US 2022/0036566 A1, Feb. 3, 2022
Int. Cl. G06T 7/246 (2017.01); A61H 3/06 (2006.01); G06F 18/22 (2023.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06V 20/58 (2022.01); G06V 40/16 (2022.01)
CPC G06T 7/246 (2017.01) [A61H 3/061 (2013.01); G06F 18/22 (2023.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06V 20/58 (2022.01); G06V 40/174 (2022.01); A61H 2201/5092 (2013.01); G06V 2201/07 (2022.01)] 15 Claims
OG exemplary drawing
 
1. A communication support device comprising:
an imaging unit that captures an image of a surrounding environment of a user to acquire a captured image;
a counterpart detector that detects a plurality of predetermined counterparts in the captured image;
a priority level setting unit that sets priority levels respectively for the plurality of counterparts based on a predetermined relationship between the user and each of the plurality of counterparts;
a priority determination unit that determines priorities of the plurality of counterparts based on the priority levels;
a notification unit that selects information regarding the plurality of counterparts based on the priorities and notifies the user of the selected information;
a distance measuring unit that measures a distance between each of the plurality of counterparts and the imaging unit based on the captured image;
an expression determination unit that determines a facial expression of each of the plurality of counterparts based on the captured image; and
a motion determination unit that determines a motion of each of the plurality of counterparts based on the captured image,
wherein the notification unit:
notifies the user of identification information for identifying a most preferred counterpart by a voice when a first distance between the imaging unit and the most preferred counterpart with the priority being a first priority, measured by the distance measuring unit, is an interaction distance of a first threshold or less, and
notifies the user of the identification information and at least one of facial expression information related to the facial expression determined by the expression determination unit and motion information related to the motion determined by the motion determination unit by a voice when the first distance is longer than the first threshold.