US 12,017,663 B2
Sensor aggregation framework for autonomous driving vehicles
Liangliang Zhang, Sunnyvale, CA (US); Dong Li, Sunnyvale, CA (US); Jiangtao Hu, Sunnyvale, CA (US); Jiaming Tao, Sunnyvale, CA (US); and Yifei Jiang, Sunnyvale, CA (US)
Assigned to BAIDU USA LLC, Sunnyvale, CA (US)
Filed by Baidu USA LLC, Sunnyvale, CA (US)
Filed on Mar. 18, 2021, as Appl. No. 17/205,725.
Application 17/205,725 is a continuation of application No. 15/952,101, filed on Apr. 12, 2018, granted, now 10,983,524.
Prior Publication US 2021/0208597 A1, Jul. 8, 2021
Int. Cl. B60W 50/00 (2006.01); G01C 21/34 (2006.01); G05D 1/00 (2006.01); G06N 20/00 (2019.01); G06V 10/776 (2022.01); G06V 10/96 (2022.01); G06V 20/58 (2022.01)
CPC B60W 50/0097 (2013.01) [G01C 21/3446 (2013.01); G05D 1/0088 (2013.01); G05D 1/0214 (2013.01); G05D 1/0221 (2013.01); G06N 20/00 (2019.01); G06V 10/776 (2022.01); G06V 10/96 (2022.01); G06V 20/58 (2022.01)] 21 Claims
OG exemplary drawing
 
1. A computer-implemented method of training a set of parameters for subsequent use in controlling an autonomous driving vehicle, comprising:
collecting sensor data from one or more sensors mounted on an autonomous driving vehicle (ADV) while the ADV is moving within a region of interest (ROI) that includes a plurality of obstacles, the sensor data including obstacle information of the obstacles and vehicle data of the ADV, each of the vehicle data including driving commands issued and responses of the ADV at a specific point in time, wherein the driving commands issued include a throttle, brake, or steering command of the ADV, and the responses of the ADV include a speed, acceleration, deceleration, or direction of the ADV;
timestamping each of the vehicle data with a current time at which the vehicle data is captured to generate a plurality of timestamps that correspond to the vehicle data, the plurality of timestamps being mapped to the specific point in time of the driving commands issued and the responses of the ADV; and
aggregating the obstacle information, the vehicle data, and the corresponding timestamps into training data to align timing of the obstacle information with the plurality of timestamps of the throttle, the brake, or the steering command of the driving commands issued and the speed, the acceleration, the deceleration, or the direction of the responses of the ADV, wherein the training data is used to train a set of parameters that is subsequently utilized to predict at least in part future obstacle behaviors and vehicle movement of the ADV.