US 11,670,040 B2
Three dimensional scene inpainting using stereo extraction
Nir Daube, Pacific Palisades, CA (US); and Zachi Karni, Givat Ella (IL)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Aug. 4, 2021, as Appl. No. 17/394,164.
Application 17/394,164 is a continuation of application No. 16/559,852, filed on Sep. 4, 2019, granted, now 11,094,108.
Claims priority of provisional application 62/737,280, filed on Sep. 27, 2018.
Prior Publication US 2021/0366182 A1, Nov. 25, 2021
Int. Cl. G06T 15/20 (2011.01); G06T 5/00 (2006.01); G06T 7/194 (2017.01); G06T 7/11 (2017.01); G06T 7/55 (2017.01); G06T 5/50 (2006.01)
CPC G06T 15/205 (2013.01) [G06T 5/005 (2013.01); G06T 5/50 (2013.01); G06T 7/11 (2017.01); G06T 7/194 (2017.01); G06T 7/55 (2017.01)] 20 Claims
OG exemplary drawing
 
1. A system for creating a three-dimensional (3D) scene, the system comprising:
eyewear including a first imager and a second imager spaced from the first imager, the first imager configured to obtain a first two-dimensional (2D) image of a scene object from a first viewpoint and the second imager configured to obtain a second 2D image of the scene object from a second viewpoint that is different than the first viewpoint; and
a processing system coupled to the eyewear, the processing system configured to:
create a 3D scene from the first and second 2D images;
detect regions of the 3D scene with incomplete image information by identifying contiguous faces of the 3D scene including degenerated faces having at least one angle that is less than a threshold value;
reconstruct the detected regions of the 3D scene;
determine replacement information and modify the reconstructed regions; and
render the 3D scene with the modified reconstructed regions from a plurality of viewpoints.