US 11,902,712 B2
Apparatus and method of acquiring image by employing color separation lens array
Sangyun Lee, Yongin-si (KR); Moongi Kang, Seoul (KR); Seokho Yun, Seoul (KR); Jonghyun Kim, Goyang-si (KR); and Kyeonghoon Jeong, Seoul (KR)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR); and INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY, Seoul (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR); and INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY, Seoul (KR)
Filed on Nov. 3, 2021, as Appl. No. 17/518,181.
Claims priority of application No. 10-2020-0149592 (KR), filed on Nov. 10, 2020.
Prior Publication US 2022/0150453 A1, May 12, 2022
Int. Cl. G02B 27/10 (2006.01); H04N 23/88 (2023.01); H04N 23/84 (2023.01); H04N 25/13 (2023.01); H04N 9/01 (2023.01); H04N 9/64 (2023.01)
CPC H04N 9/01 (2023.01) [G02B 27/1013 (2013.01); H04N 9/646 (2013.01); H04N 23/843 (2023.01); H04N 23/88 (2023.01); H04N 25/13 (2023.01)] 23 Claims
OG exemplary drawing
 
1. An apparatus for acquiring image data, the apparatus comprising:
an image sensor including a sensor substrate and a color separation lens array, wherein the sensor substrate includes a plurality of photo-sensing cells, and the color separation lens array configured to separate an incident light into a plurality of lights having different wavelengths and form a phase distribution for condensing the plurality of lights having the different wavelengths on adjacent photo-sensing cells of the plurality of photo-sensing cells; and
a signal processor configured to estimate a blur kernel in a spatial domain based on a difference between a first image in which only a spectral resolution is deteriorated by a crosstalk point spread function (PSF) of the color separation lens array and a second image in which both the spectral resolution and a spatial resolution are deteriorated by the PSF, perform deconvolution on sensing signals of the plurality of photo-sensing cells based on the estimated blur kernel to obtain a sub-sampled image, perform demosaicing to restore a full resolution image having a full resolution from the sub-sampled image, and correct a color of the full resolution image using the crosstalk PSF of the color separation lens array.