US 11,954,755 B2
Image processing device and operation method thereof
Jihye Lee, Suwon-si (KR); Taegyu Lim, Suwon-si (KR); Taeoh Kim, Seodaemun-gu (KR); Hyeongmin Lee, Seodaemun-gu (KR); and Sangyoun Lee, Seodaemun-gu (KR)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR); and INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY, Seoul (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR); and INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY, Seoul (KR)
Filed on Nov. 12, 2021, as Appl. No. 17/525,620.
Application 17/525,620 is a continuation of application No. PCT/KR2020/004561, filed on Apr. 3, 2020.
Claims priority of application No. 10-2019-0056553 (KR), filed on May 14, 2019.
Prior Publication US 2022/0076062 A1, Mar. 10, 2022
Int. Cl. G06T 1/00 (2006.01); G06F 18/213 (2023.01); G06F 18/22 (2023.01); G06F 18/23 (2023.01); G06F 18/28 (2023.01); G06N 3/04 (2023.01); G06V 10/44 (2022.01); G06V 10/82 (2022.01)
CPC G06T 1/00 (2013.01) [G06F 18/213 (2023.01); G06F 18/22 (2023.01); G06F 18/23 (2023.01); G06F 18/28 (2023.01); G06N 3/04 (2013.01); G06V 10/454 (2022.01); G06V 10/82 (2022.01)] 17 Claims
OG exemplary drawing
 
1. An image processing device comprising:
a memory configured to store one or more instructions; and
a processor configured to execute the one or more instructions stored in the memory to:
extract one or more input patches based on an input image;
extract one or more pieces of feature information respectively corresponding to the one or more input patches, based on a dictionary including mapping information indicating mappings between a plurality of patches and pieces of feature information respectively corresponding to the plurality of patches; and
obtain a final image by performing a convolution operation between the extracted one or more pieces of feature information and a filter kernel,
wherein the dictionary is generated based on pieces of feature information output at an n−1-th convolution layer of a deep neural network (DNN) that includes n convolution layers and is trained to output a second image by performing image processing on a first image according to a preset purpose, and
the filter kernel is based on a filter kernel included in an n-th convolution layer of the DNN.