US 12,437,203 B2
Apparatus, system and method for translating sensor label data between sensor domains
Nasim Souly, San Mateo, CA (US); and Pratik Prabhanjan Brahma, Belmont, CA (US)
Assigned to Volkswagen Aktiengesellschaft, Wolfsburg (DE)
Filed by VOLKSWAGEN AKTIENGESELLSCHAFT, Wolfsburg (DE)
Filed on Feb. 18, 2021, as Appl. No. 17/179,214.
Prior Publication US 2022/0261658 A1, Aug. 18, 2022
Int. Cl. G06N 3/08 (2023.01); G06N 3/045 (2023.01); G06N 3/088 (2023.01)
CPC G06N 3/088 (2013.01) [G06N 3/045 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A method of converting sensor data for autonomous vehicle perception, comprising:
receiving, by a processing system of an autonomous vehicle, first sensor data from a first sensor, wherein the first sensor data comprises a first operational characteristic capability and first sensor label data comprising at least one of semantic segmentation labels or bounding box masks;
applying, by the processing system, a machine-learning model comprising an encoder-decoder network to the first sensor data, wherein the machine-learning model is trained to translate the first sensor data to emulate second sensor data comprising a second operational characteristic capability different from the first operational characteristic capability;
generating, by the processing system, new sensor data corresponding to the applied machine-learning model, wherein the new sensor data comprises translated first sensor label data emulating the second operational characteristic capability; and
applying, by the processing system, a loss function to the new sensor data to validate the accuracy of the new sensor data and translated first sensor label data; and
configuring the processing system of the autonomous vehicle to perform object detection using the validated new sensor data and translated first sensor label data.