US 12,223,628 B2
Electronic device for performing image deblurring and controlling method of electronic device
Valery Valerievich Anisimovskiy, Moscow (RU); Maksim Alexandrovich Penkin, Moscow (RU); Evgeny Andreevich Dorokhov, Moscow (RU); Aleksei Mikhailovich Gruzdev, Moscow (RU); and Sergey Stanislavovich Zavalishin, Moscow (RU)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Jun. 30, 2021, as Appl. No. 17/364,274.
Claims priority of application No. 2020121995 (RU), filed on Jul. 2, 2020; and application No. 10-2020-0138644 (KR), filed on Oct. 23, 2020.
Prior Publication US 2022/0005160 A1, Jan. 6, 2022
Int. Cl. G06T 5/73 (2024.01); G06N 3/045 (2023.01); G06T 7/246 (2017.01)
CPC G06T 5/73 (2024.01) [G06N 3/045 (2023.01); G06T 7/248 (2017.01); G06T 2207/10016 (2013.01); G06T 2207/20024 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20201 (2013.01)] 4 Claims
OG exemplary drawing
 
1. An electronic device comprising:
a memory configured to store at least one neural network model to perform deblurring of an image; and
a processor configured to:
detect, using a motion sensor, blur information characterizing motion of a camera at a time of capturing an image,
input the image comprising a blurred area and the blur information to a first neural network model to obtain a first feature information corresponding to the image and to obtain a weight value information corresponding to the first feature information,
obtain a global shift information indicating whether an image shift included in the image is local in certain areas of the image or global throughout a scene in the image
based on the global shift information indicating that the image shift included in the image is local in the certain areas of the image, identify the scene included in the image as a dynamic scene, obtain a second feature information in which the first feature information is filtered by performing a recurrent filtering process based on the first feature information and the weight value information through a second neural network model and obtain an image in which the blurred area is deblurred by inputting the second feature information to a third neural network model, and
based on the global shift information indicating that the image shift included in the image is global throughout the scene in the image, identify the scene included in the image as a static scene, and obtain an image in which the blurred area is deblurred by inputting the first feature information to the third neural network model without activating the second neural network model.