US 11,893,716 B2
Image processing apparatus and image processing method, and image capturing apparatus
Naoko Watazawa, Tokyo (JP)
Assigned to Canon Kabushiki Kaisha, Tokyo (JP)
Filed by CANON KABUSHIKI KAISHA, Tokyo (JP)
Filed on Jul. 6, 2021, as Appl. No. 17/367,657.
Application 17/367,657 is a continuation of application No. 16/804,197, filed on Feb. 28, 2020, granted, now 11,089,236.
Claims priority of application No. 2019-040881 (JP), filed on Mar. 6, 2019.
Prior Publication US 2021/0344846 A1, Nov. 4, 2021
Int. Cl. G06T 5/00 (2006.01); G06T 7/50 (2017.01); G06F 18/211 (2023.01); H04N 23/76 (2023.01); G06V 10/141 (2022.01); G06V 10/60 (2022.01); G06V 10/145 (2022.01); G06V 40/16 (2022.01)
CPC G06T 5/008 (2013.01) [G06F 18/211 (2023.01); G06T 5/00 (2013.01); G06T 7/50 (2017.01); G06V 10/141 (2022.01); G06V 10/145 (2022.01); G06V 10/60 (2022.01); G06V 40/166 (2022.01); H04N 23/76 (2023.01); G06T 2207/20104 (2013.01); G06T 2207/30201 (2013.01)] 12 Claims
OG exemplary drawing
 
1. An image processing apparatus comprising:
an acquisition unit that acquires (a) a first image obtained through shooting and (b) distance information of the first image, wherein the distance information includes information on a distance to a subject in the first image in a depth direction;
a detection unit that detects a main subject from the first image;
an extraction unit that extracts another subject that exists in a predetermined region of the first image, the predetermined region being within a predetermined distance in the first image from the main subject, based on the distance information of the main subject;
a setting unit that sets parameters of one or more virtual light sources that emit virtual light to the main subject and the another subject; and
a processing unit that generates, from the first image, a second image in which the main subject and the another subject are illuminated with the virtual light using the parameters set by the setting unit,
wherein each unit is implemented by one or more processors, circuitry, or a combination thereof.