US 11,989,983 B2
Deep learning of fault detection in onboard automobile systems
LuAn Tang, Pennington, NJ (US); Haifeng Chen, West Windsor, NJ (US); Wei Cheng, Princeton, NJ (US); Junghwan Rhee, Edmond, OK (US); and Jumpei Kamimura, South Brunswick, NJ (US)
Assigned to NEC Corporation, Tokyo (JP)
Filed by NEC Laboratories America, Inc., Princeton, NJ (US)
Filed on Apr. 27, 2021, as Appl. No. 17/241,481.
Claims priority of provisional application 63/021,291, filed on May 7, 2020.
Prior Publication US 2021/0350636 A1, Nov. 11, 2021
Int. Cl. G07C 5/08 (2006.01); B60W 50/02 (2012.01); B60W 50/035 (2012.01); B60W 50/038 (2012.01); G06N 3/044 (2023.01); G06N 3/045 (2023.01); G06N 3/08 (2023.01); G06N 3/088 (2023.01); G07C 5/00 (2006.01)
CPC G07C 5/085 (2013.01) [B60W 50/0205 (2013.01); B60W 50/035 (2013.01); B60W 50/038 (2013.01); G06N 3/044 (2023.01); G06N 3/045 (2023.01); G06N 3/08 (2013.01); G06N 3/088 (2013.01); G07C 5/008 (2013.01); G07C 5/0808 (2013.01); B60W 2710/06 (2013.01); B60W 2710/18 (2013.01)] 13 Claims
OG exemplary drawing
 
1. A method for vehicle fault detection, comprising:
collecting operational data from a plurality of sensors in a vehicle, the plurality of sensors being associated with a plurality of vehicle sub-systems;
concatenating data features from the operational data with a sensor correlation graph that includes indications of correlations between groups of related sub-systems;
processing the concatenated data with a neural network to generate a fault score, which represents a similarity to fault state training scenarios, and an anomaly score, which represents a dissimilarity to normal state training scenarios;
determining that the fault score is above a fault score threshold and that the anomaly score is above an anomaly score threshold to detect a fault; and
performing a corrective action responsive the fault, based on a sub-system associated with the fault, selected from the group consisting of changing an operational status of one or more of the plurality of vehicle sub-systems, changing the setting of a device in the vehicle, stopping an engine of the vehicle, applying brakes of the vehicle, and changing operational properties of the engine, transmission or brakes of the vehicle to compensate for adverse conditions.