US 11,941,965 B2
Information processing apparatus issuing warning to person at risky point, information processing method, and non-transitory storage medium
Yurika Tanaka, Yokosuka (JP); Shuichi Sawada, Nagoya (JP); Takaharu Ueno, Nagoya (JP); Shin Sakurada, Toyota (JP); Daiki Yokoyama, Gotemba (JP); and Genshi Kuno, Kasugai (JP)
Assigned to TOYOTA JIDOSHA KABUSHIKI KAISHA, Toyota (JP)
Filed by TOYOTA JIDOSHA KABUSHIKI KAISHA, Toyota (JP)
Filed on Aug. 4, 2021, as Appl. No. 17/394,026.
Claims priority of application No. 2020-136041 (JP), filed on Aug. 11, 2020.
Prior Publication US 2022/0051540 A1, Feb. 17, 2022
Int. Cl. G06K 9/00 (2022.01); G06V 20/52 (2022.01); G06V 40/20 (2022.01); G08B 21/04 (2006.01); G08B 3/10 (2006.01)
CPC G08B 21/0476 (2013.01) [G06V 20/52 (2022.01); G06V 40/20 (2022.01); G08B 3/10 (2013.01)] 10 Claims
OG exemplary drawing
 
1. An information processing apparatus comprising:
a communication interface;
a memory in which information indicating one or more states of a person that are associated with one or more states of risks are stored; and
a controller configured to execute:
receiving registration information via the communication interface, the registration information transmitted from a mobile terminal and including identification information of the mobile terminal and information indicating an attribute of a person carrying the mobile terminal, the attribute of the person being at least one of a person being an elderly person and a person being a disabled person;
storing the registration information in the memory;
receiving a captured image captured by a camera via the communication interface;
detecting a risky point from the captured image by performing a determination process using matching with an image of a state where safety is secured, the risky point being a point, on a movement route of persons, where safety of movement is reduced by occurrence of an event compared to before the occurrence of the event;
detecting, from the captured image, information indicating a state of risk at the risky point and information indicating a position of the risky point;
detecting, from the captured image, a person of a first group with a predetermined positional relationship to the risky point by performing a facial recognition on the captured image;
receiving positional information of the mobile terminal via the communication interface, the positional information transmitted from the mobile terminal on a regular basis;
detecting a person of a second group with the predetermined positional relationship to the risky point, the person of the second group carrying the mobile terminal, based on the information indicating the position of the risky point and the positional information of the mobile terminal;
acquiring the information indicating the attribute of the person carrying the mobile terminal from the registration information stored in the memory;
determining whether or not the person of the second group is at least one of the elderly person and the disabled person based on the information indicating the attribute of the person;
creating information indicating a first warning based on the information indicating the state of risk at the risky point in a case where the person of the second group is determined to be at least one of the elderly person and the disabled person, the information indicating the first warning including the information indicating the state of risk at the risky point;
transmitting the information indicating the first warning to the mobile terminal that the person of the second group carries via the communication interface based on the identification information of the mobile terminal and transmitting the information indicating the first warning to a speaker or a display device nearest to the risky point via the communication interface based on the information indicating the position of the risky point;
detecting information indicating a state of the person of the first group by performing an image recognition on the captured image in a case where the person of the second group is determined to be neither of the elderly person and the disabled person;
determining whether or not the state of the person of the first group is a state where there is a high possibility of being put in danger, among a plurality of states of the person of the first group assumable at the risky point based on the information indicating the one or more states of the person stored in the memory and the information indicating the state of the person of the first group;
creating information indicating a second warning based on the information indicating the state of risk at the risky point and the information indicating the state of the person of the first group in a case where the state of the person of the first group is determined to be the state where there is the high possibility of being put in danger, the information indicating the second warning including the information indicating the state of risk at the risky point and information indicating a state of a person who is highly likely to be put in danger, the information indicating the state of the person who is highly likely to be put in danger corresponding to the state of risk; and
transmitting the information indicating the second warning to the speaker or the display device via the communication interface based on the information indicating the position of the risky point.