US 12,140,961 B2
Automatic roller path tracking and mapping for pavement compaction using infrared thermography
Fei Dai, Morgantown, WV (US); and Linjun Lu, Morgantown, WV (US)
Assigned to West Virginia University Board of Governors on Behalf of West Virginia University, Morgantown, WV (US)
Filed by West Virginia University Board of Governors on Behalf of West Virginia University, Morgantown, WV (US)
Filed on Nov. 29, 2021, as Appl. No. 17/536,418.
Claims priority of provisional application 63/124,120, filed on Dec. 11, 2020.
Prior Publication US 2022/0187842 A1, Jun. 16, 2022
Int. Cl. G05D 1/00 (2024.01); B60R 1/22 (2022.01); B60R 11/04 (2006.01); E01C 19/28 (2006.01); H04N 5/33 (2023.01); E01C 19/48 (2006.01)
CPC G05D 1/0242 (2013.01) [B60R 1/22 (2022.01); B60R 11/04 (2013.01); E01C 19/288 (2013.01); H04N 5/33 (2013.01); B60Y 2200/41 (2013.01); B60Y 2400/3015 (2013.01); E01C 19/488 (2013.01); G05D 1/02 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system, comprising:
an infrared (IR) camera disposed on a roller vehicle used for compacting a surface;
at least one computing device in data communication with the IR camera; and
at least one application executable in the at least one computing device, wherein, when executed, the at least one application causes the at least one computing device to at least:
obtain a plurality of images from the IR camera the plurality of images showing a path ahead of the roller vehicle;
perform an analysis comprising boundary identification and feature tracking of at least one feature point associated with at least one cold point between boundaries, wherein the feature tracking tracks the at least one feature point through multiple ones of the plurality of images based at least in part on an optical flow vector field;
generate mapping and tracking data associated with a movement of the roller vehicle, the mapping and tracking data being based at least in part on the analysis of the images obtained from the IR camera;
generate a user interface comprising a visual representation of the tracking and mapping data associated with the compaction of the road surface; and
display the user interface via a display device of the at least one computing device, wherein an operator of the roller vehicle adjusts at least one of a roller position or a roller movement based at least in part on the tracking and mapping data displayed on the at least one computing device.