US 12,238,259 B2
Image processing method, image processing apparatus, storage medium, manufacturing method of learned model, and image processing system
Yoshinori Kimura, Tochigi (JP)
Assigned to CANON KABUSHIKI KAISHA, Tokyo (JP)
Filed by CANON KABUSHIKI KAISHA, Tokyo (JP)
Filed on Apr. 29, 2022, as Appl. No. 17/732,609.
Claims priority of application No. 2021-081785 (JP), filed on May 13, 2021.
Prior Publication US 2022/0368877 A1, Nov. 17, 2022
Int. Cl. H04N 13/128 (2018.01); G06T 7/571 (2017.01); G06T 7/593 (2017.01); H04N 5/232 (2006.01); H04N 23/67 (2023.01); H04N 13/00 (2018.01)
CPC H04N 13/128 (2018.05) [G06T 7/571 (2017.01); G06T 7/593 (2017.01); H04N 23/676 (2023.01); G06T 2207/10148 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); H04N 2013/0081 (2013.01)] 12 Claims
OG exemplary drawing
 
1. An image processing method comprising:
a first step of acquiring a first image having disparity information and refocus information; and
a second step of inputting the first image or the disparity information and the refocus information into a machine learning model, and of generating a second image having an in-focus position different from an in-focus position of the first image based on the refocus information,
wherein the refocus information is information on a distance between the in-focus position of the first image and the in-focus position of the second image,
wherein the machine learning model includes a first machine learning model and a second machine learning model, and
wherein the second step includes the steps of:
inputting two viewpoint images acquired from the first image into the first machine learning model and extracting the disparity information; and
inputting the disparity information and the refocus information into the second machine learning model and generating the second image.