US 12,469,208 B2
Generation apparatus, generation method, and non-transitory computer-readable storage medium
Shohei Iwamoto, Kanagawa (JP); Rumie Oishi, Saitama (JP); and Haruhisa Nakamura, Kanagawa (JP)
Assigned to Canon Kabushiki Kaisha, Tokyo (JP)
Filed by CANON KABUSHIKI KAISHA, Tokyo (JP)
Filed on Jul. 26, 2023, as Appl. No. 18/359,707.
Claims priority of application No. 2022-125088 (JP), filed on Aug. 4, 2022; and application No. 2023-098260 (JP), filed on Jun. 15, 2023.
Prior Publication US 2024/0046552 A1, Feb. 8, 2024
Int. Cl. G06T 15/20 (2011.01)
CPC G06T 15/20 (2013.01) 6 Claims
OG exemplary drawing
 
1. A virtual viewpoint image generation apparatus comprising:
one or more memories storing instructions; and
one or more processors executing the instruction to:
obtain a foreground model that is generated based on a plurality of captured images and that represents a three-dimensional shape of a foreground;
obtain a virtual object model that represents a three-dimensional shape of a virtual object;
obtain viewpoint information that represents a position of a virtual viewpoint and a view direction from the virtual viewpoint; and
generate a virtual viewpoint image based on the obtained foreground model, the obtained virtual object model, and the obtained viewpoint information,
wherein the virtual object has a shape with an alternate repetition of one of a plurality of first planes and one of a plurality of second planes,
wherein a normal line of each first plane and a normal line of each second plane extend in different directions,
wherein a virtual viewpoint image generated based on first viewpoint information on a first virtual viewpoint represents the plurality of first planes but does not represent the plurality of second planes, and
wherein a virtual viewpoint image generated based on second viewpoint information on a second virtual viewpoint includes the plurality of second planes but does not include the plurality of first planes.