US 12,441,371 B2
Driver and environment monitoring to predict human driving maneuvers and reduce human driving errors
Rafael Rosales, Bavaria (DE); Ignacio J. Alvarez, Portland, OR (US); Florian Geissler, Munich (DE); Neslihan Kose Cihangir, Bavaria (DE); and Michael Paulitsch, Ottobrunn (DE)
Assigned to Intel Corporation, Santa Clara, CA (US)
Filed by Intel Corporation, Santa Clara, CA (US)
Filed on Jun. 21, 2021, as Appl. No. 17/352,560.
Prior Publication US 2021/0309261 A1, Oct. 7, 2021
Int. Cl. B60W 60/00 (2020.01); B60W 40/08 (2012.01); B60W 50/00 (2006.01); G06V 20/56 (2022.01); G06V 20/59 (2022.01)
CPC B60W 60/0051 (2020.02) [B60W 40/08 (2013.01); B60W 60/001 (2020.02); B60W 60/0059 (2020.02); G06V 20/597 (2022.01); B60W 2420/40 (2013.01); G06V 20/56 (2022.01)] 26 Claims
OG exemplary drawing
 
1. A vehicle, comprising:
maneuver prediction processing circuitry configured to:
receive a first data stream comprising driver state data that includes images of a driver of the vehicle;
receive a second data stream comprising vehicle state data that includes images of an exterior of the vehicle,
wherein the first data stream and the second data stream are received concurrently and within a sampling window of a predetermined time duration;
upon expiration of the predetermined time duration, (i) calculate, based upon an analysis of the images of the driver of the vehicle, a first probability from among a first set of probabilities of execution of each respective one of a first set of vehicle maneuvers, (ii) calculate, based upon an analysis of the images of the exterior of the vehicle, a second probability from among a second set of probabilities of execution of each respective one of a second set of vehicle maneuvers, and (iii) predict a vehicle maneuver based upon a weighted combination of the first probability and the second probability;
monitoring circuitry configured to categorize a consequence resulting from an execution of the predicted vehicle maneuver into one of a plurality of risk-based categories, each one of the plurality of risk-based categories being based upon a severity of danger resulting from the execution of the predicted vehicle maneuver in a driving environment of the vehicle; and
a controller configured to cause the vehicle to perform a corrective action that is based upon the one of the plurality of risk-based categories that the consequence resulting from the execution of the predicted vehicle maneuver is categorized.