US 12,260,515 B2
Image processing device, image processing method, and image processing program
Kosuke Kajimura, Tokyo (JP); Ryosuke Mochizuki, Tokyo (JP); Kenichi Onomura, Tokyo (JP); and Eiji Furukawa, Saitama (JP)
Assigned to OLYMPUS CORPORATION, Tokyo (JP)
Filed by OLYMPUS CORPORATION, Hachioji (JP)
Filed on Mar. 31, 2022, as Appl. No. 17/709,616.
Application 17/709,616 is a continuation of application No. PCT/JP2020/001860, filed on Jan. 21, 2020.
Prior Publication US 2022/0222777 A1, Jul. 14, 2022
Int. Cl. G06T 3/4053 (2024.01); G06T 5/50 (2006.01)
CPC G06T 3/4053 (2013.01) [G06T 5/50 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20221 (2013.01)] 12 Claims
OG exemplary drawing
 
1. An image processing device that combines a plurality of time-series images to generate a composite image with a higher resolution than a resolution of the plurality of images, the image processing device comprising:
a processor comprising hardware, the processor being configured to:
detect depth information of at least one image of the plurality of images; and
set a number of images to be combined for generating the composite image based on the detected depth information,
wherein the depth information indicates a depth of a captured scene of the at least one image,
wherein the processor is configured to reduce the number of images as the depth of the captured scene increases, and
wherein the processor is configured to set the number of images based on the depth of the captured scene and a closest distance, and increase a contribution of the depth of the captured scene to a reduction in the number of images as a closest distance decreases, the closest distance being a subject distance to a closest subject of subjects in the at least one image.
 
3. An image processing device that combines a plurality of time-series images to generate a composite image with a higher resolution than a resolution of the plurality of images, the image processing device comprising:
a processor comprising hardware, the processor being configured to:
detect depth information of at least one image of the plurality of images; and
set a number of images to be combined for generating the composite image based on the detected depth information,
wherein the depth information indicates a depth of a captured scene of the at least one image,
wherein the processor is configured to reduce the number of images as the depth of the captured scene increases, and
wherein the processor is configured to set the number of images based on the depth of the captured scene and a focal length of an imaging apparatus that has acquired the plurality of time-series images, and increase a contribution of the depth of the captured scene to a reduction in the number of images as the focal length increases.
 
4. An image processing method for combining a plurality of time-series images to generate a composite image with a higher resolution than a resolution of the plurality of images, the image processing method comprising:
detecting depth information of at least one image of the plurality of images; and
setting a number of images to be combined for generating the composite image based on the detected depth information,
wherein the depth information indicates a depth of a captured scene of the at least one image,
wherein in the setting, the number of images is reduced as the depth of the captured scene increases, and
wherein, in the setting, the number of images is set based on the depth of the captured scene and a closest distance, and a contribution of the depth of the captured scene to a reduction in the number of images is increased as a closest distance decreases, the closest distance being a subject distance to a closest subject of subjects in the at least one image.
 
5. A non-transitory computer-readable medium having an image processing program stored therein, the program being for causing a processor to execute image processing for combining a plurality of time-series images to generate a composite image with a higher resolution than a resolution of the plurality of images, the program causing the processor to execute functions of:
detecting depth information of at least one image of the plurality of images; and
setting a number of images to be combined for generating the composite image based on the detected depth information,
wherein the depth information indicates a depth of a captured scene of the at least one image,
wherein in the setting, the number of images is reduced as the depth of the captured scene increases, and
wherein in the setting, the number of images is set based on the depth of the captured scene and a closest distance, and a contribution of the depth of the captured scene to a reduction in the number of images is increased as a closest distance decreases, the closest distance being a subject distance to a closest subject of subjects in the at least one image.
 
9. An image processing method for combining a plurality of time-series images to generate a composite image with a higher resolution than a resolution of the plurality of images, the image processing method comprising:
detecting depth information of at least one image of the plurality of images; and
setting a number of images to be combined for generating the composite image based on the detected depth information,
wherein the depth information indicates a depth of a captured scene of the at least one image,
wherein in the setting, the number of images is reduced as the depth of the captured scene increase,
wherein in the setting, the number of images is set based on the depth of the captured scene and a focal length of an imaging apparatus that has acquired the plurality of time-series images, and a contribution of the depth of the captured scene to a reduction in the number of images is increased as the focal length increases.