US 12,254,570 B2
Generating three-dimensional representations for digital objects utilizing mesh-based thin volumes
Sai Bi, San Jose, CA (US); Yang Liu, Cambridge (GB); Zexiang Xu, San Diego, CA (US); Fujun Luan, Santa Clara, CA (US); and Kalyan Sunkavalli, San Jose, CA (US)
Assigned to Adobe Inc., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on May 3, 2022, as Appl. No. 17/661,878.
Prior Publication US 2023/0360327 A1, Nov. 9, 2023
Int. Cl. G06T 17/20 (2006.01); G06T 13/20 (2011.01)
CPC G06T 17/205 (2013.01) [G06T 13/20 (2013.01); G06T 2210/21 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:
generating, from a set of digital images portraying a digital object, a mesh for the digital object utilizing a multi-view stereo model;
building a thin volume around the mesh by:
generating one or more rays from a source point to the mesh, the one or more rays intersecting the mesh at one or more locations;
determining a plurality of sample points positioned off the mesh and positioned on the one or more rays intersecting the mesh; and
determining a set of sample points for the thin volume that includes one or more sample points from the plurality of sample points that are positioned off the mesh and within a threshold distance of the mesh and excludes at least one sample point from the plurality of sample points that is positioned off the mesh and outside the threshold distance of the mesh,
wherein the thin volume includes digital data representing features of the digital object within the threshold distance of the mesh; and
generating, utilizing a neural network, a three-dimensional hybrid mesh-volumetric representation for the digital object utilizing the set of sample points for the thin volume and the mesh.