CPC G06T 15/50 (2013.01) [G06T 7/50 (2017.01); G06T 7/90 (2017.01); G06T 15/08 (2013.01); G06T 15/10 (2013.01); G06T 17/20 (2013.01); G06T 2207/10012 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20212 (2013.01); G06T 2207/30244 (2013.01)] | 15 Claims |
1. A method of generating a multi-layer representation of a scene, the method comprising:
obtaining a pair of images of the scene, the pair of the images comprising a reference image and a source image;
performing a reprojection operation on the pair of images to generate a plane-sweep volume;
predicting, using a geometry network, a layered structure of the scene based on the plane-sweep volume; and
estimating, using a coloring network, color values and opacity values for the predicted layered structure of the scene to obtain the multi-layer representation of the scene;
wherein the geometry network and the coloring network are trained in end-to-end manner.
|