US 11,941,781 B2
Method and apparatus for restoring image
Deokyoung Kang, Suwon-si (KR); and Yang Ho Cho, Seongnam-si (KR)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Apr. 16, 2020, as Appl. No. 16/850,724.
Claims priority of application No. 10-2019-0155506 (KR), filed on Nov. 28, 2019.
Prior Publication US 2021/0166352 A1, Jun. 3, 2021
Int. Cl. G06T 5/00 (2006.01); G06N 3/08 (2023.01); G06N 20/00 (2019.01); G06T 5/50 (2006.01)
CPC G06T 5/001 (2013.01) [G06N 3/08 (2013.01); G06N 20/00 (2019.01); G06T 5/006 (2013.01); G06T 5/50 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An image restoration method comprising:
acquiring a target image including a plurality of individual images included in a Compound Eye Vision (CEV) image captured by a plurality of lens elements included in a multi-lens array of a camera;
inputting the CEV image as the target image together with pixel position information of the plurality of individual images to an image restoration model; and
obtaining a restoration image of the target image from the image restoration model based on the target image and the pixel position information,
wherein the CEV image is acquired by overlapping capturing of a same scene with different viewpoints,
wherein the CEV image that is acquired based on intensities of external rays received by a plurality of sensing elements after passing through the plurality of lens elements included in the multi-lens array of the camera, and
wherein the pixel position information comprises a first image in which a first value changes based on a distance from a reference point in polar coordinates, the reference point being a principle point of a lens that captured the target image.