US 12,189,036 B2
Multi-sensor calibration system
Chenzhe Qian, San Diego, CA (US); Ji Zhao, Beijing (CN); and Zhibei Ma, San Diego, CA (US)
Assigned to TUSIMPLE, INC., San Diego, CA (US)
Filed by TUSIMPLE, INC., San Diego, CA (US)
Filed on Nov. 17, 2023, as Appl. No. 18/512,205.
Application 18/512,205 is a continuation of application No. 16/937,508, filed on Jul. 23, 2020, granted, now 11,908,163.
Claims priority of application No. 202010598425.2 (CN), filed on Jun. 28, 2020.
Prior Publication US 2024/0095960 A1, Mar. 21, 2024
Int. Cl. G01S 17/89 (2020.01); G06T 3/14 (2024.01); G06T 7/521 (2017.01); G06T 7/80 (2017.01); G06V 10/24 (2022.01); G06V 10/80 (2022.01); G06V 20/56 (2022.01); H04N 23/00 (2023.01); G06V 10/62 (2022.01)
CPC G01S 17/89 (2013.01) [G06T 3/14 (2024.01); G06T 7/521 (2017.01); G06T 7/80 (2017.01); G06V 10/24 (2022.01); G06V 10/80 (2022.01); G06V 20/588 (2022.01); H04N 23/00 (2023.01); G06T 2207/30204 (2013.01); G06T 2207/30256 (2013.01); G06V 10/62 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method of estimating parameters for vehicle operation, comprising:
obtaining, from each of at least two sensors located on a vehicle, a sensor data item of a segment of a road comprising a lane marker, wherein point cloud data (PCD) of the segment of the road that comprises the lane marker is obtained from a Light Detection and Ranging (LiDAR) sensor located on the vehicle, wherein the at least two sensors include the LiDAR sensor, and wherein the sensor data item is obtained from each of the at least two sensors as the vehicle is driven on the road;
determining, from each sensor data item, a location information of the lane marker comprising pixel locations of corners of the lane marker;
deriving, for each corner of the lane marker, a first distance between a pixel location of a corner of the lane marker and previously stored 3D world coordinates of the corner of the lane marker;
deriving, for each corner of the lane marker, a second distance between 3D world coordinates of the corner of the lane marker calculated based on a coordinate system of the LiDAR sensor and the previously stored 3D world coordinates of the corner of the lane marker; and
estimating extrinsic parameters for the at least two sensors based on the first distance and the second distance, respectively.