US 11,938,083 B2
Walking support system
Kohei Shintani, Nisshin (JP); and Hiroaki Kawamura, Nagoya (JP)
Assigned to TOYOTA JIDOSHA KABUSHIKI KAISHA, Aichi-Ken (JP)
Filed by TOYOTA JIDOSHA KABUSHIKI KAISHA, Aichi-ken (JP)
Filed on Mar. 7, 2022, as Appl. No. 17/688,006.
Claims priority of application No. 2021-081466 (JP), filed on May 13, 2021.
Prior Publication US 2022/0370283 A1, Nov. 24, 2022
Int. Cl. A61H 3/06 (2006.01)
CPC A61H 3/061 (2013.01) [A61H 2003/063 (2013.01); A61H 2201/5007 (2013.01); A61H 2201/5048 (2013.01); A61H 2201/5092 (2013.01); A61H 2201/5097 (2013.01)] 9 Claims
OG exemplary drawing
 
1. A walking support system that recognizes a traffic light located in front of a pedestrian in a walking direction and that performs at least one of a stop instruction to the pedestrian before a crosswalk and a crossing start instruction of the crosswalk to the pedestrian according to a state of the traffic light, the walking support system comprising:
an image acquisition unit that is able to acquire an image in front of the pedestrian in the walking direction;
a traffic light first recognition unit that performs a recognition operation of the traffic light for the image acquired by the image acquisition unit using a learned model based on pre-annotated data;
a traffic light second recognition unit that performs a recognition operation of the traffic light for the image acquired by the image acquisition unit based on a feature amount of the traffic light; and
a determination unit that determines whether the traffic light is recognized in the image based on each of a result of the recognition operation by the traffic light first recognition unit and a result of the recognition operation by the traffic light second recognition unit,
wherein when the determination unit obtains a result that the traffic light is recognized in both the recognition operation by the traffic light first recognition unit and the recognition operation by the traffic light second recognition unit, the determination unit determines that the traffic light is recognized in front in the walking direction, and when the determination unit obtains a result that the traffic light is not recognized in both the recognition operation by the traffic light first recognition unit and the recognition operation by the traffic light second recognition unit, the determination unit determines that the traffic light does not exist in front in the walking direction.