US 12,014,552 B2
Intelligent vehicle systems and control logic for incident prediction and assistance in off-road driving situations
Ariel Telpaz, Givat Haim Meuhad (IL); Ravid Erez, Hod-Hashron (IL); Michael Baltaxe, Kfar Saba (IL); Barak Hershkovitz, Even Yehuda (IL); Nadav Baron, Herzliya (IL); and Christopher A Stanek, Lake Orion, MI (US)
Assigned to GM Global Technology Operations LLC, Detroit, MI (US)
Filed by GM GLOBAL TECHNOLOGY OPERATIONS LLC, Detroit, MI (US)
Filed on Dec. 7, 2021, as Appl. No. 17/544,195.
Prior Publication US 2023/0177840 A1, Jun. 8, 2023
Int. Cl. G06V 20/56 (2022.01); B60R 16/023 (2006.01); G05D 1/00 (2024.01); G06V 10/25 (2022.01); G06V 10/26 (2022.01); G06V 10/44 (2022.01); G06V 10/62 (2022.01); G06V 10/82 (2022.01); G07C 5/00 (2006.01); G07C 5/02 (2006.01); H04N 23/90 (2023.01)
CPC G06V 20/56 (2022.01) [B60R 16/0231 (2013.01); G05D 1/0214 (2013.01); G05D 1/0246 (2013.01); G06V 10/25 (2022.01); G06V 10/267 (2022.01); G06V 10/44 (2022.01); G06V 10/62 (2022.01); G06V 10/82 (2022.01); G07C 5/008 (2013.01); G07C 5/02 (2013.01); H04N 23/90 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A method for controlling operation of a motor vehicle with a sensor array including a network of cameras mounted at discrete locations on the motor vehicle, the method comprising:
receiving, via a system controller through a wireless communications device, vehicle geolocation data indicating the motor vehicle is in or entering an off-road terrain;
receiving, via the system controller from the sensor array responsive to the vehicle geolocation data, camera data indicative of camera-generated images captured by the cameras and containing a drive wheel of the motor vehicle and a terrain surface of the off-road terrain;
receiving, via the system controller from a controller area network (CAN) bus, vehicle operating characteristics data and vehicle dynamics data for the motor vehicle;
processing the camera data, the vehicle operating characteristics data, and the vehicle dynamics data via a convolutional neural network (CNN) backbone to predict occurrence of a driving incident on the off-road terrain within a prediction time horizon; and
transmitting, via the system controller, a command signal to a resident vehicle system to execute a control operation responsive to the predicted occurrence of the driving incident.