US 11,943,419 B2
Depth of field image refocusing
Benjamin Busam, Munich (DE); Matthieu Hog, Munich (DE); Steven George McDonagh, London (GB); and Gregory Slabaugh, Munich (DE)
Assigned to Huawei Technologies Co., Ltd., Shenzhen (CN)
Filed by HUAWEI TECHNOLOGIES CO., LTD., Guangdong (CN)
Filed on Sep. 20, 2021, as Appl. No. 17/479,911.
Application 17/479,911 is a continuation of application No. PCT/EP2019/057138, filed on Mar. 21, 2019.
Prior Publication US 2022/0006998 A1, Jan. 6, 2022
Int. Cl. G06T 7/593 (2017.01); G06N 20/00 (2019.01); H04N 13/128 (2018.01); H04N 13/00 (2018.01)
CPC H04N 13/128 (2018.05) [G06N 20/00 (2019.01); G06T 7/593 (2017.01); G06T 2207/10028 (2013.01); H04N 2013/0081 (2013.01)] 14 Claims
OG exemplary drawing
 
1. An image processing device comprising:
at least one processor;
a non-transitory computer-readable storage medium coupled to the at least one processor and storing programming instructions for execution by the at least one processor, wherein the programming instructions instruct the image processing device to generate a refocused image from an input image and a map indicating depth information for the input image, wherein generating the refocused image and the map comprises:
for each of a plurality of planes associated with respective depths within the image:
generating a depth mask having values indicating whether regions of the input image are within a specified range of the plane, wherein an assessment of whether a region is within the specified range of the plane is made through an evaluation of a differentiable function of a range between regions of the input image and the plane as determined from the map, wherein the differentiable function varies smoothly between a lower bound and an upper bound that defines a function value range, the differentiable function having a value within a first half of its range when an image region for which the differentiable function is being evaluated is within the specified range of the plane, and having a value within a second half of its range when an image region for which the differentiable function is being evaluated is not within the specified range of the plane;
generating a masked image from the input image and the depth mask; and
refocusing the masked image using a blurring kernel to generate a refocused partial image; and
generating the refocussed image from the refocussed partial images.