| CPC G06T 19/006 (2013.01) [B60R 21/015 (2013.01); G06V 10/764 (2022.01); G06V 20/58 (2022.01); B60R 2021/01013 (2013.01); G06V 2201/07 (2022.01)] | 3 Claims |
|
1. A method of providing warning to an occupant within a vehicle prior to the occupant exiting the vehicle, comprising:
detecting, with a system controller in communication with a plurality of onboard sensors and an occupant monitoring system, when an occupant within the vehicle is about to exit the vehicle by:
determining, with the system controller, if the vehicle is at least one of: stopped, parked and not-running;
determining, with the system controller, via the occupant monitoring system, if the occupant is reaching for a door latch within the vehicle; and
actuating, with the system controller, external cameras on the vehicle and capturing, with the external cameras, images of the environment outside the vehicle when at least one of:
the vehicle is at least one of stopped, parked and not-running; and
the occupant is reaching for the door latch within the vehicle;
detecting, with the system controller, a position of the occupant within the vehicle;
capturing, with the system controller and the plurality of onboard sensors, images of an environment outside the vehicle;
displaying, with the system controller, on a display screen adapted to be viewed by the occupant, a view of the environment outside of the vehicle, including at least one of:
displaying, with the system controller, on a dedicated display screen mounted onto the door of the vehicle, the view of the environment outside the vehicle; and
displaying, with the system controller, on a display screen of an onboard infotainment system, the view of the environment outside the vehicle;
detecting, with the system controller, and the plurality of onboard sensors, at least one moving object and at least one stepping hazard within the environment outside the vehicle based on real-time data collected by the plurality of onboard sensors, analysis of captured images of the environment outside the vehicle using computer vision and image recognition techniques and data from past occurrences of identifying hazardous objects stored within a database in communication with the system controller, analyzing the speed, position, acceleration, trajectory and recent changes to any of the speed, position, acceleration and trajectory of the at least one moving object relative to the vehicle;
determining, with the system controller, a probability that the at least one moving object will collide with at least one of the door of the vehicle and the occupant during the occupant's exit from the vehicle by probabilistically calculating, with a machine learning algorithm, a probability that the at least one moving object will collide with at least one of the door of the vehicle and the occupant during the occupant's exit from the vehicle based on real-time data collected by the plurality of onboard sensors, analysis of captured images of the environment outside the vehicle using computer vision and image recognition techniques and data from past occurrences of identifying and classifying hazardous objects stored within the database;
determining, with the system controller, a probability that the at least one stepping hazard will cause the occupant to at least one of trip, stumble and fall during the occupant's exit from the vehicle by probabilistically calculating, with a machine learning algorithm, a probability that the at least one stepping hazard will cause the occupant to at least one of trip, stumble and fall during the occupant's exit from the vehicle based on real-time data collected by the plurality of onboard sensors, analysis of captured images of the environment outside the vehicle using computer vision and image recognition techniques and data from past occurrences of identifying and classifying hazardous objects stored within the database; and
when there is a hazardous object within the environment outside the vehicle:
classifying the hazardous object by determining a relative severity of the hazardous object;
providing augmented reality alerts overlayed onto the hazardous object within the display screen including one of:
displaying an augmented reality alert overlayed onto a single hazardous object that is color coded based on the relative severity of the single hazardous object; and
displaying an augmented reality alert overlayed onto each one of a plurality of hazardous objects, each augmented reality alert color coded based on the relative severity of the one of the plurality of hazardous objects onto which the augmented reality alert is overlayed;
determining, with the system controller, if a door of the vehicle has been opened;
when the vehicle door has been opened, determining, with the system controller if additional alerts are necessary; and
if additional alerts are necessary, initiating, with the system controller, additional alerts.
|