US 12,187,270 B2
Devices and methods for predicting intersection violations and/or collisions
Benjamin Oren Alpert, Sunnyvale, CA (US); Tahmida Binte Mahmud, San Jose, CA (US); Alexander Dion Wu, San Carlos, CA (US); Piyush Chandra, Belmont, CA (US); Jeremy Marschke, San Carlos, CA (US); Gary Kwan, Belmont, CA (US); Stefan Heck, Palo Alto, CA (US); Ruslan Belkin, Sunnyvale, CA (US); and Ilan Hornstein, Menlo Park, CA (US)
Assigned to Nauto, Inc., Palo Alto, CA (US)
Filed by Nauto, Inc., Palo Alto, CA (US)
Filed on Jun. 15, 2021, as Appl. No. 17/348,727.
Prior Publication US 2021/0312193 A1, Oct. 7, 2021
Int. Cl. B60W 30/09 (2012.01); B60W 30/18 (2012.01); B60W 40/08 (2012.01); G06N 3/04 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/56 (2022.01); G06V 20/59 (2022.01); G06V 40/20 (2022.01); G08G 1/0962 (2006.01); H04N 7/18 (2006.01)
CPC B60W 30/09 (2013.01) [B60W 30/18159 (2020.02); B60W 40/08 (2013.01); G06N 3/04 (2013.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/588 (2022.01); G06V 20/597 (2022.01); G06V 40/23 (2022.01); G08G 1/0962 (2013.01); H04N 7/181 (2013.01); B60W 2420/403 (2013.01); B60W 2540/223 (2020.02)] 57 Claims
OG exemplary drawing
 
1. An apparatus comprising:
a first camera configured to view an environment outside a vehicle;
a second camera configured to view a driver of the vehicle; and
a processing unit configured to receive a first image from the first camera, and a second image from the second camera;
wherein the processing unit is configured to determine first information indicating a risk of intersection violation based at least partly on the first image;
wherein the processing unit is configured to determine second information indicating a state of the driver based at least partly on the second image;
wherein the processing unit is configured to determine whether to provide a control signal for operating a device or not based on (1) the first information indicating the intersection violation, and (2) the second information indicating the state of the driver; and
wherein the processing unit is configured to utilize a first neural network model to process the first image to determine the first information indicating the risk of the intersection violation.