US 11,836,879 B2
Information processing apparatus, information processing method, and storage medium for correcting a shift between three-dimensional positions
Nozomu Kasuya, Kanagawa (JP)
Assigned to CANON KABUSHIKI KAISHA, Tokyo (JP)
Filed by CANON KABUSHIKI KAISHA, Tokyo (JP)
Filed on Feb. 3, 2021, as Appl. No. 17/166,681.
Claims priority of application No. 2020-018275 (JP), filed on Feb. 5, 2020.
Prior Publication US 2021/0241541 A1, Aug. 5, 2021
Int. Cl. G06T 19/20 (2011.01); G06T 7/73 (2017.01); G06T 7/593 (2017.01); H04N 13/111 (2018.01); H04N 13/282 (2018.01); H04N 23/68 (2023.01)
CPC G06T 19/20 (2013.01) [G06T 7/593 (2017.01); G06T 7/73 (2017.01); H04N 13/111 (2018.05); H04N 13/282 (2018.05); H04N 23/683 (2023.01); G06T 2200/08 (2013.01); G06T 2207/10012 (2013.01); G06T 2219/2016 (2013.01); G06T 2219/2021 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An information processing apparatus comprising one or more memories storing instructions; and one or more processors that execute the instructions to:
acquire a plurality of images to be used in generating image content based on capturing an image of an image capturing region at a predetermined time point from different directions by a plurality of image capturing apparatuses;
acquire a plurality of pieces of image capturing information including information representing at least one of positions and orientations of the plurality of image capturing apparatuses corresponding to the plurality of images; and
correct a shift between a first three-dimensional position in the image capturing region specified based on a position of a first feature point on a first image among the plurality of images and the image capturing information about a first image capturing apparatus among the plurality of image capturing apparatuses that corresponds to the first image and a second three-dimensional position in the image capturing region specified based on a position of a second feature point corresponding to the first feature point on a second image among the plurality of images and the image capturing information about a second image capturing apparatus among the plurality of image capturing apparatuses that corresponds to the second image,
wherein the plurality of images are respectively acquired by the plurality of image capturing apparatuses at a specific time point, wherein each image of the plurality of images acquired by each image capturing apparatus of the plurality of image capturing apparatuses has undergone a correction to correct a shift between a feature point in the image and a corresponding feature point in a reference image acquired by the image capturing apparatus at a different time point from the specific time point,
wherein the first image is acquired by the first image capturing apparatus at the specific time point and has undergone a correction to correct a shift between a feature point in the first image and a corresponding feature point in a reference image acquired by the first image capturing apparatus at a different time point from the specific time point, and
the second image is acquired by the second image capturing apparatus at the specific time point and has undergone a correction to correct a shift between a feature point in the second image and a corresponding feature point in a reference image acquired by the second image capturing apparatus at a different time point from the specific time point,
wherein the one or more processors execute the instructions to:
select the first image and the second image from the plurality of images based on reliability of the correction on each image to correct the shift between the feature point in the image and the corresponding feature point in the reference image, such that the reliability of the correction on the first image is higher than the reliability of the correction on the second image; and
correct the image capturing information about the second image capturing apparatus and/or the second image based on the first image to correct the shift between the first three-dimensional position and the second three-dimensional position.