US 11,670,120 B2
System and method for monitoring test data for autonomous operation of self-driving vehicles
Amir J. Kibbar, Livermore, CA (US); Shenghui Sun, Redwood City, CA (US); and Yung-Jin Hu, Fremont, CA (US)
Assigned to TOYOTA RESEARCH INSTITUTE, INC., Los Altos, CA (US)
Filed by TOYOTA RESEARCH INSTITUTE, INC., Los Altos, CA (US)
Filed on Aug. 31, 2020, as Appl. No. 17/7,648.
Prior Publication US 2022/0068050 A1, Mar. 3, 2022
Int. Cl. G06N 20/00 (2019.01); G06F 11/36 (2006.01); G07C 5/08 (2006.01); G07C 5/00 (2006.01); G05D 1/02 (2020.01); G01M 17/007 (2006.01)
CPC G07C 5/0808 (2013.01) [G05D 1/0221 (2013.01); G06F 11/3616 (2013.01); G06N 20/00 (2019.01); G07C 5/008 (2013.01); G07C 5/0841 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method for autonomous vehicle test data distribution and analysis, comprising:
operating an autonomous test vehicle during a test run including another vehicle;
uploading driving session test data from a computer of a drive site to a network attached storage of the drive site, in which the driving session test data comprises a drive log and measured telemetry information, captured sensor data, and selected vehicle control actions during the test run of the autonomous test vehicle;
uploading the driving session test data from the network attached storage of the drive site to a cloud-based storage location;
filtering the driving session test data from the cloud-based storage location according to a first work unit and a first processing unit assigned to a first research site, and a second work unit and a second processing unit assigned to a second research site;
distributing, through a data distribution pipeline, the filtered driving session test data and the first work unit and the first processing task to the first research site and the second work unit and the second processing task to the second research site, in which both the first research site and the second research site are geographically remote and separate from the drive site;
processing, by the first research site, the filtered driving session test data according to a processing task associated with the first work unit to output processed sensor data, the vehicle control actions, and a processed drive log and telemetry information to the data distribution pipeline using the first processing unit; and
autonomously verifying, by the second research site, the selected vehicle control actions according to a machine learning test verification task associated with the second work unit according to the processed sensor data and the processed drive log and telemetry information received from the data distribution pipeline using the second processing unit.