US 11,836,888 B2
Method and apparatus for processing RGB-infrared (RGB-IR) sensor
Shashank Dabral, Allen, TX (US); Gang Hua, Katy, TX (US); and Mihir Narendra Mody, Bangalore (IN)
Assigned to Texas Instruments Incorporated, Dallas, TX (US)
Filed by Texas Instruments Incorporated, Dallas, TX (US)
Filed on Dec. 21, 2020, as Appl. No. 17/129,818.
Prior Publication US 2022/0198604 A1, Jun. 23, 2022
Int. Cl. G06T 3/40 (2006.01); H04N 5/33 (2023.01); H01L 27/146 (2006.01); H04N 25/13 (2023.01); H04N 25/131 (2023.01)
CPC G06T 3/4015 (2013.01) [H01L 27/14621 (2013.01); H01L 27/14649 (2013.01); H04N 5/33 (2013.01); H04N 25/134 (2023.01); H04N 25/131 (2023.01)] 27 Claims
OG exemplary drawing
 
1. A method comprising:
determining whether to process a raw RGB-Infrared (RGB-IR) image in day mode or night mode;
responsive to determining to process in the day mode, interpolating the raw RGB-IR image to generate Bayer image data comprising a plurality of color pixel values and IR image data comprising a plurality of JR pixel values, and combining the Bayer image data with the IR image data to generate an IR subtracted Bayer image,
wherein the combining includes weighting each of at least some of the plurality of color pixel values, weighting each of at least some of the plurality of IR pixel values, and subtracting each weighted IR pixel value from the corresponding weighted color pixel value to generate the IR subtracted Bayer image;
responsive to determining to process in the day mode, processing the IR subtracted Bayer image in an image signal processor (ISP); and
responsive to determining to process in the night mode, generating an IR image from the raw RGB-IR image.