US 11,755,469 B2
System for executing structured tests across a fleet of autonomous vehicles
Ghassan Atmeh, Grosse Pointe Woods, MI (US)
Assigned to ARGO AI, LLC, Pittsburgh, PA (US)
Filed by Argo AI, LLC, Pittsburgh, PA (US)
Filed on Sep. 24, 2020, as Appl. No. 17/30,702.
Prior Publication US 2022/0091973 A1, Mar. 24, 2022
Int. Cl. G05D 1/00 (2006.01); G06F 11/36 (2006.01); G06F 11/30 (2006.01); G06F 11/34 (2006.01)
CPC G06F 11/3692 (2013.01) [G05D 1/0088 (2013.01); G06F 11/3086 (2013.01); G06F 11/3476 (2013.01); G05D 2201/0213 (2013.01); G06F 2201/835 (2013.01)] 17 Claims
OG exemplary drawing
 
9. A system for testing an autonomous vehicle, the system comprising:
an on-board computing system of the autonomous vehicle comprising an electronic device; and
a computer-readable storage medium comprising one or more programming instructions that, when executed, cause the electronic device to:
obtain a list of one or more required tests the autonomous vehicle is to run, wherein each of the one or more required tests is part of a commissioning process for the autonomous vehicle;
cause the list to be displayed on a display device of the autonomous vehicle;
receive a selection of an identifier for a selected test and an input for starting speed control from an operator of the autonomous vehicle;
control the autonomous vehicle to reach a particular speed that is to be attained before the selected test can be performed;
receive a user-software interaction to cause instructions for the selected test to be obtained from an electronic device located remote from the autonomous vehicle, responsive to the autonomous vehicle reaching the particular speed;
generate a request for a test input profile associated with the selected test, responsive to the user-software interaction;
communicate the request for the test input profile from the autonomous vehicle to the electronic device located remote from the autonomous vehicle;
receive the test input profile from the electronic device, wherein the test input profile comprises the instructions for the autonomous vehicle to execute to perform the selected test;
cause the autonomous vehicle to execute at least a portion of the one or more instructions of the test input profile;
log response data to one or more log files, wherein the response data comprises data measuring the autonomous vehicle's autonomous response to executing the at least a portion of the one or more instructions of the selected test;
during execution of the one or more test instructions, generate metadata associated with the selected test, wherein the metadata comprises a start timestamp that corresponds to a time when the selected test begins and an end timestamp that corresponds to a time when the selected test ends;
log the metadata to the one or more log files;
transmit at least a portion of the one or more log files to a first electronic device located remotely from the autonomous vehicle; and
receive parameters representing physical properties of vehicle motion that were identified for a plurality of models that are to be relied upon by the on-board computing system for autonomous motion control of the autonomous vehicle, the parameters being identified based on at least one segment of the response data associated with a timestamp falling within a range defined by the start and end timestamps associated with the selected test;
wherein the plurality of models comprise models of physical components of the autonomous vehicle and models of motion responses by the autonomous vehicle.