US 12,145,578 B2
Devices and methods for assisting operation of vehicles based on situational assessment fusing expoential risks (SAFER)
Stefan Peter Heck, Palo Alto, CA (US); Benjamin Oren Alpert, Sunnyvale, CA (US); Tahmida Binte Mahmud, San Jose, CA (US); Mohammad Saad Billah, San Jose, CA (US); and Ilan Hornstein, Menlo Park, CA (US)
Assigned to Nauto, Inc., Palo Alto, CA (US)
Filed by Nauto, Inc., Palo Alto, CA (US)
Filed on Apr. 21, 2022, as Appl. No. 17/726,236.
Claims priority of provisional application 63/285,073, filed on Dec. 1, 2021.
Prior Publication US 2023/0166743 A1, Jun. 1, 2023
Int. Cl. G06F 17/00 (2019.01); B60Q 9/00 (2006.01); B60W 30/09 (2012.01); B60W 30/095 (2012.01); B60W 40/08 (2012.01); B60W 50/00 (2006.01); B60W 50/14 (2020.01); G05B 13/02 (2006.01); G06N 3/04 (2023.01); G07C 5/04 (2006.01)
CPC B60W 30/095 (2013.01) [B60Q 9/008 (2013.01); B60W 30/09 (2013.01); B60W 40/08 (2013.01); B60W 50/0097 (2013.01); B60W 50/14 (2013.01); G05B 13/027 (2013.01); G06N 3/04 (2013.01); G07C 5/04 (2013.01); B60W 2050/143 (2013.01); B60W 2050/146 (2013.01); B60W 2420/403 (2013.01); B60W 2420/408 (2024.01); B60W 2520/10 (2013.01); B60W 2540/00 (2013.01); B60W 2554/802 (2020.02); B60W 2556/10 (2020.02)] 25 Claims
OG exemplary drawing
 
1. An apparatus comprising:
a first sensor configured to provide a first input associated with an environment outside a vehicle;
a second sensor configured to provide a second input associated with an operation of the vehicle; and
a processing unit configured to receive the first input from the first sensor, and the second input from the second sensor;
wherein the processing unit comprises a first-stage processing system and a second-stage processing system;
wherein the first-stage processing system is configured to receive the first input from the first sensor and the second input from the second sensor, process the first input to obtain a first time series of information, and process the second input to obtain a second time series of information;
wherein the second-stage processing system comprises a neural network model configured to receive the first time series of information and a second time series of information in parallel; and
wherein the neural network is configured to process the first time series and the second time series to determine a probability of a predicted event associated with an operation of the vehicle.