US 12,086,212 B2
Burst image-based image restoration method and apparatus
Jaeseok Choi, Yongin-si (KR); Nahyup Kang, Seoul (KR); Hyongeuk Lee, Suwon-si (KR); and Byungin Yoo, Seoul (KR)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed on Jul. 13, 2021, as Appl. No. 17/374,174.
Claims priority of application No. 10-2021-0017439 (KR), filed on Feb. 8, 2021.
Prior Publication US 2022/0253642 A1, Aug. 11, 2022
Int. Cl. G06F 18/25 (2023.01); G06N 3/08 (2023.01); G06T 5/70 (2024.01); G06T 5/73 (2024.01); G06V 10/46 (2022.01)
CPC G06F 18/253 (2023.01) [G06N 3/08 (2013.01); G06T 5/70 (2024.01); G06T 5/73 (2024.01); G06V 10/462 (2022.01)] 19 Claims
OG exemplary drawing
 
1. An image restoration method comprising:
determining an anchor image based on individual images of a burst image set without aligning the individual images;
executing a feature extraction network based on the burst image set while using anchor information of the anchor image; and
generating a restored image based on a feature map corresponding to an output of the feature extraction network,
wherein the executing of the feature extraction network includes fusing the anchor information of the anchor image with features of the individual images,
wherein the executing of the feature extraction network comprises extracting a local feature while using the anchor information for each of a plurality of layer groups of the feature extraction network, and
wherein the executing of the local feature comprises:
extracting a primary local feature from a first individual image of the individual images using a first layer group of the plurality of layer groups;
transforming the primary local feature by fusing the anchor information with the primary local feature;
extracting a secondary local feature from the transformed primary local feature using a second layer group of the plurality of layer groups; and
determining a global feature based on the secondary local feature.