US 11,706,402 B2
Image generation apparatus, image generation method, and program
Motohiro Makiguchi, Tokyo (JP); and Hideaki Takada, Tokyo (JP)
Assigned to NIPPON TELEGRAPH AND TELEPHONE CORPORATION, Tokyo (JP)
Appl. No. 17/614,987
Filed by NIPPON TELEGRAPH AND TELEPHONE CORPORATION, Tokyo (JP)
PCT Filed May 31, 2019, PCT No. PCT/JP2019/021743
§ 371(c)(1), (2) Date Nov. 29, 2021,
PCT Pub. No. WO2020/240827, PCT Pub. Date Dec. 3, 2020.
Prior Publication US 2022/0239894 A1, Jul. 28, 2022
Int. Cl. H04N 13/366 (2018.01); H04N 13/156 (2018.01); G06T 7/00 (2017.01); H04N 13/363 (2018.01)
CPC H04N 13/366 (2018.05) [G06T 7/0002 (2013.01); H04N 13/156 (2018.05); H04N 13/363 (2018.05); G06T 2207/20212 (2013.01); G06T 2207/30168 (2013.01)] 9 Claims
OG exemplary drawing
 
1. An image generation apparatus wherein:
k as a parameter representing an integer, and P1 and P3 as projectors; and
a viewpoint corresponding to an installation position of a projector P2k−1 as an observation viewpoint V2k−1 (1≤k≤2), a viewpoint corresponding to an intermediate position of installation positions of the two adjacent projectors P1 and P3 as an intermediate viewpoint V2, an image in the observation viewpoint V2k−1 as an observation viewpoint image I2k−1 (1≤k≤2), and an image in the intermediate viewpoint V2 as an intermediate viewpoint image I2,
the image generation apparatus comprising:
a synthesis ratio determiner configured to determine a synthesis ratio A by using an observation viewpoint image I1, the intermediate viewpoint image I2, and an observation viewpoint image I3; and
an output image generator configured to generate an output image S1 of the projector P1 from the observation viewpoint image I1 and the intermediate viewpoint image I2, and an output image S3 of the projector P3 from the observation viewpoint image I3 and the intermediate viewpoint image I2, by using the synthesis ratio A,
wherein the synthesis ratio determiner includes:
an image quality evaluation index determiner configured to generate a synthesis image J1 from the observation viewpoint image I1 and the intermediate viewpoint image I2, and a synthesis image J3 from the observation viewpoint image I3 and the intermediate viewpoint image I2, for a plurality of synthesis ratios (each synthesis ratio is a real number 0 or greater and 1 or smaller), determine an image quality evaluation index in an observation viewpoint V1, an image quality evaluation index in the intermediate viewpoint V2, and an image quality evaluation index in an observation viewpoint V3 by using the synthesis images J1 and J3, and determine a variation v of an image quality evaluation index by using the image quality evaluation index in the observation viewpoint V1, the image quality evaluation index in the intermediate viewpoint V2, and the image quality evaluation index in the observation viewpoint V3; and
an image quality evaluation index comparator configured to determine the synthesis ratio A based on the variation v of the image quality evaluation index.