US 12,279,050 B2
Phase-detection image sensor remosaicing
Yiyi Ren, Cupertino, CA (US); Wenshou Chen, Santa Clara, CA (US); Lei Fan, Santa Clara, CA (US); and Nian Xiong, Santa Clara, CA (US)
Assigned to OmniVision Technologies, Inc., Santa Clara, CA (US)
Filed by OmniVision Technologies, Inc., Santa Clara, CA (US)
Filed on May 24, 2023, as Appl. No. 18/323,173.
Prior Publication US 2024/0397211 A1, Nov. 28, 2024
Int. Cl. H04N 23/84 (2023.01); H04N 25/704 (2023.01)
CPC H04N 23/843 (2023.01) [H04N 25/704 (2023.01)] 26 Claims
OG exemplary drawing
 
1. An imaging system comprising:
a phase-detection (PD) image sensor comprising a plurality of PD pixel units, each PD pixel unit comprising a first left PD pixel and a first right PD pixel, the first left PD pixel and the first right PD pixel covered by a microlens;
wherein the plurality of PD pixel units comprise green PD pixel units forming a green image, blue PD pixel units forming a blue image, and red PD pixel units forming a red image; and
wherein the green image, the blue image, and red image form a color image arranged in an original Bayer pattern comprising the green PD pixel units, the blue PD pixel units, and the red PD pixel units;
a processor configured to:
interpolate the green image to obtain a full resolution interpolated green image including defocused portions having artifacts and in-focus portions having sharp image;
low-pass filter the full resolution interpolated green image to obtain a blurred image of the full resolution interpolated green image;
combine the full resolution interpolated green image and the blurred image of the full resolution interpolated green image to obtain a corrected full resolution interpolated green image;
wherein the artifacts of the defocused portions of the full resolution interpolated green image are removed, and the sharp image of the in-focus portions of the full resolution interpolated green image is unaffected;
spatial-variant convolute the full resolution interpolated green image with a bilateral kernel, wherein the bilateral kernel is a multiplication product of a spatial kernel and a range kernel.