US 12,333,650 B2
Three-dimensional asset reconstruction
Mikhail Vasilkovskii, London (GB); Sergey Demyanov, Brooklyn, NY (US); and Vladislav Shakhrai, London (GB)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Mikhail Vasilkovskii, London (GB); Sergey Demyanov, Brooklyn, NY (US); and Vladislav Shakhrai, London (GB)
Filed on Sep. 12, 2022, as Appl. No. 17/942,796.
Prior Publication US 2024/0087229 A1, Mar. 14, 2024
Int. Cl. G06T 17/20 (2006.01); G06T 7/73 (2017.01); G06T 15/04 (2011.01)
CPC G06T 17/20 (2013.01) [G06T 7/74 (2017.01); G06T 15/04 (2013.01); G06T 2200/24 (2013.01); G06T 2207/30244 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An asset reconstruction system comprising:
a plurality of cameras statically positioned within a darkroom, the cameras configured and positioned to capture images of an object positioned within the darkroom from a plurality of viewpoints surrounding the object;
at least one light source configured to illuminate the object, each light source having a respective location;
one or more computer processors; and
a memory storing instructions that, when executed by the one or more computer processors, cause the asset reconstruction system to perform operations for generating a three-dimensional (3D) asset representing the object, the operations comprising:
capturing a set of images of the object from the plurality of viewpoints surrounding the object with the plurality of cameras statically positioned within the darkroom;
estimating camera poses for each respective image of the set of images;
constructing a 3D surface mesh comprising a plurality of surfaces using the set of images and the camera poses estimated for each respective image; and
optimizing texture properties of the plurality of surfaces of the 3D surface mesh to generate the 3D asset.