US 11,783,532 B1
View synthesis using attribute correspondences and geometric relationship constraints
Hang Su, Cambridge, MA (US); Zitian Chen, Amherst, MA (US); and Orazio Gallo, Santa Cruz, CA (US)
Assigned to NVIDIA Corporation, Santa Clara, CA (US)
Filed by NVIDIA Corporation, Santa Clara, CA (US)
Filed on Dec. 22, 2021, as Appl. No. 17/558,881.
Int. Cl. G06T 15/10 (2011.01); G06V 10/82 (2022.01); G06T 15/06 (2011.01); G06T 1/20 (2006.01); G06T 7/20 (2017.01); G06T 7/60 (2017.01); G06T 7/70 (2017.01); G06F 18/21 (2023.01)
CPC G06T 15/10 (2013.01) [G06F 18/21 (2023.01); G06T 1/20 (2013.01); G06T 7/20 (2013.01); G06T 7/60 (2013.01); G06T 7/70 (2017.01); G06T 15/06 (2013.01); G06V 10/82 (2022.01)] 14 Claims
OG exemplary drawing
 
1. A computer-implemented method for synthesizing a target image corresponding to a target camera pose, comprising:
receiving a first source image and a second source image of a scene, wherein the first source image corresponds to a first source camera pose and the second source image corresponds to a second source camera pose;
receiving pixel attribute correspondences for the first and second source images, wherein the pixel attribute correspondences comprise optical flow;
defining a first epipolar line in the first source image by projecting a ray traced from the target camera pose through a target pixel in the target image to the first source image according to first geometric relationships between the first source camera pose and the target camera pose;
defining a second epipolar line in the second source image by projecting the ray to the second source image according to second geometric relationships between the second source camera pose and the target camera pose;
mapping, according to the pixel attribute correspondences, first pixels along the first epipolar line in the first source image to second locations in the second source image;
identifying one location of the second locations that is within a threshold distance from the second epipolar line;
selecting a source pixel as a pixel of the first pixels along the first epipolar line that is mapped to the identified one location in the second source image; and
transferring attributes of the source pixel to the target pixel.