US 11,727,639 B2
Shape refinement of three-dimensional (3D) mesh reconstructed from images
Jie Hu, San Jose, CA (US); and Mohammad Gharavi-Alkhansari, San Jose, CA (US)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Filed by SONY GROUP CORPORATION, Tokyo (JP)
Filed on Aug. 23, 2021, as Appl. No. 17/408,928.
Prior Publication US 2023/0056800 A1, Feb. 23, 2023
Int. Cl. G06T 17/20 (2006.01); G06T 19/20 (2011.01); G06T 5/00 (2006.01); G06T 15/50 (2011.01); G06T 5/30 (2006.01)
CPC G06T 17/205 (2013.01) [G06T 5/002 (2013.01); G06T 5/30 (2013.01); G06T 15/503 (2013.01); G06T 19/20 (2013.01); G06T 2207/20192 (2013.01); G06T 2207/30196 (2013.01); G06T 2219/2021 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An electronic device, comprising:
circuitry configured to:
acquire a set of images of an object;
estimate a first three-dimensional (3D) mesh of a head portion of the object, based on the acquired set of images;
execute a first set of operations on the estimated first 3D mesh to generate a second 3D mesh, wherein the executed first set of operations comprises one or more of:
a removal of one or more regions which are unneeded for head-shape estimation, and
a removal of one or more mesh artifacts associated with a 3D shape or a topology of the first 3D mesh;
acquire a 3D template mesh;
process the 3D template mesh to determine a set of filling patches corresponding to a set of holes in the generated second 3D mesh;
refine a boundary associated with each of the set of holes in the generated second 3D mesh, by execution of an erosion operation over the boundary associated with each of the set of holes; and
execute, based on the generated second 3D mesh, the refinement of the boundary, and the determined set of filling patches, a hole filling operation to generate a final 3D mesh.