US 12,084,071 B1
Simulation stability analyses based on parameter perturbation
Joseph Gribble, Foster City, CA (US); and Peter Scott Schleede, Foster City, CA (US)
Assigned to Zoox, Inc., Foster City, CA (US)
Filed by Zoox, Inc., Foster City, CA (US)
Filed on Dec. 22, 2020, as Appl. No. 17/131,559.
Int. Cl. B60W 50/06 (2006.01); G06F 11/34 (2006.01)
CPC B60W 50/06 (2013.01) [G06F 11/3457 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
one or more processors; and
one or more computer-readable media storing computer-executable instructions that, when executed, cause the one or more processors to perform operations comprising:
receiving an unperturbed driving simulation configured to simulate operation of an autonomous vehicle controller, the unperturbed driving simulation including a simulated environment and a simulated object within the simulated environment;
determining a plurality of perturbed driving simulations based on the unperturbed driving simulation, wherein determining each of the plurality of perturbed driving simulations includes:
determining a feature of the simulated object or the simulated environment; and
perturbing the feature by a perturbation value;
executing each of the plurality of perturbed driving simulations;
determining a first number of the plurality of perturbed driving simulations associated with a passing simulation result;
determining a second number of the plurality of perturbed driving simulations associated with a failing simulation result;
determining a simulation stability score associated with the unperturbed driving simulation, based at least in part on the first number and the second number;
executing the unperturbed driving simulation to determine a unperturbed simulation result;
validating, based at least in part on the unperturbed simulation result and the simulation stability score, the autonomous vehicle controller; and
based at least in part on validating the autonomous vehicle controller, transmitting the autonomous vehicle controller to an autonomous vehicle.