US 12,079,956 B2
Method and device for fusion of images
Kuldeep Shah, St. Jose, CA (US)
Assigned to Continental Autonomous Mobility US, LLC, Auburn Hills, MI (US)
Filed by Continental Automotive Systems, Inc., Auburn Hills, MI (US)
Filed on Dec. 24, 2020, as Appl. No. 17/133,776.
Prior Publication US 2022/0207673 A1, Jun. 30, 2022
Int. Cl. G06T 5/50 (2006.01)
CPC G06T 5/50 (2013.01) [G06T 2207/20081 (2013.01); G06T 2207/20221 (2013.01); G06T 2207/30196 (2013.01); G06T 2207/30261 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A method of fusing images comprising:
obtaining, by a central processing unit (CPU) of a controller, an optical image of a first scene with a first camera;
obtaining, by the CPU, a thermal image of the first scene with a second camera;
fusing, by the CPU, the optical image with the thermal image to generate a fused image, wherein fusing the optical image with the thermal image includes cropping a portion of at least one of the optical image or the thermal image so as to generate a cropped version of the at least one of the optical image or the thermal image which does not include the cropped portion, the cropped portion corresponding to a portion of the at least one of the optical image or the thermal image which is not included in the other of the at least one of the optical image of the thermal image, and using the cropped version of the at least one of the optical image or the thermal image to generate the fused image,
wherein fusing the optical image with the thermal image includes matching pixels from the optical image with corresponding pixels from the thermal image on a pixel-by-pixel basis.