US 11,689,822 B2
Dual sensor imaging system and privacy protection imaging method thereof
Shih-Yuan Peng, Hsinchu (TW); Shu-Chun Cheng, Hsinchu (TW); Hsu-Lien Huang, Taipei (TW); Yun-Chin Li, Hsinchu (TW); and Kuo-Ming Lai, Hsinchu (TW)
Assigned to Altek Semiconductor Corp., Hsinchu (TW)
Filed by Altek Semiconductor Corp., Hsinchu (TW)
Filed on Mar. 29, 2021, as Appl. No. 17/214,937.
Claims priority of provisional application 63/074,477, filed on Sep. 4, 2020.
Claims priority of application No. 109146831 (TW), filed on Dec. 30, 2020.
Prior Publication US 2021/0218871 A1, Jul. 15, 2021
Int. Cl. H04N 5/225 (2006.01); H04N 9/04 (2006.01); H04N 5/77 (2006.01); H04N 5/265 (2006.01); H04N 5/235 (2006.01); H04N 5/262 (2006.01); G06T 7/00 (2017.01); G06T 5/50 (2006.01); G06T 5/00 (2006.01); G06K 9/62 (2022.01); G06F 21/84 (2013.01); G06F 21/62 (2013.01); G06F 18/211 (2023.01); H04N 23/45 (2023.01); H04N 23/10 (2023.01); H04N 23/73 (2023.01); H04N 23/741 (2023.01); G06V 40/16 (2022.01)
CPC H04N 9/04559 (2018.08) [G06F 18/211 (2023.01); G06F 21/6245 (2013.01); G06F 21/84 (2013.01); G06T 5/005 (2013.01); G06T 5/50 (2013.01); G06T 7/0002 (2013.01); G06V 40/16 (2022.01); H04N 5/265 (2013.01); H04N 5/2628 (2013.01); H04N 5/772 (2013.01); H04N 23/10 (2023.01); H04N 23/45 (2023.01); H04N 23/73 (2023.01); H04N 23/741 (2023.01); G06T 2207/10024 (2013.01); G06T 2207/10048 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20132 (2013.01); G06T 2207/20208 (2013.01); G06T 2207/20221 (2013.01); G06T 2207/30168 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A dual sensor imaging system, comprising:
at least one color sensor;
at least one infrared ray (IR) sensor;
a storage device, storing a computer program; and
a processer, coupled to the at least one color sensor, the at least one IR sensor, and the storage device, and configured to load and execute the computer program to:
control the at least one color sensor and the at least one IR sensor to respectively capture a plurality of color images and a plurality of IR images by adopting a plurality of exposure conditions adapted for an imaging scene;
adaptively select a combination of the color image and the IR image that can reveal details of the imaging scene;
detect a feature area with at least one feature of a target of interest in the color image according to the at least one feature; and
fuse the selected color image and IR image to generate a fusion image with the details of the imaging scene, and crop an image of the feature area in the fusion image to be replaced with an image not belonging to the IR image, so as to generate a scene image;
wherein the processor:
selects one of the color images as a reference image according to color details of the color image;
identifies at least one defect area lacking texture details in the reference image; and
selects one of the IR images as the IR image for fusion with the reference image according to texture details of an image corresponding to the at least one defect area in each of the IR images.