US 12,293,465 B2
Method and apparatus for constructing three-dimensional face mesh, device, and storage medium
Xiangkai Lin, Shenzhen (CN); and Sheng Wang, Shenzhen (CN)
Assigned to TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, Shenzhen (CN)
Filed by Tencent Technology (Shenzhen) Company Limited, Shenzhen (CN)
Filed on May 23, 2022, as Appl. No. 17/751,496.
Application 17/751,496 is a continuation of application No. PCT/CN2021/097567, filed on Jun. 1, 2021.
Claims priority of application No. 202010685183.0 (CN), filed on Jul. 16, 2020.
Prior Publication US 2022/0284679 A1, Sep. 8, 2022
Int. Cl. G06T 17/20 (2006.01); G06T 3/40 (2024.01); G06T 7/64 (2017.01); G06T 7/70 (2017.01); G06T 15/04 (2011.01); G06V 40/16 (2022.01)
CPC G06T 17/205 (2013.01) [G06T 3/40 (2013.01); G06T 7/64 (2017.01); G06T 7/70 (2017.01); G06T 15/04 (2013.01); G06V 40/165 (2022.01); G06T 2200/04 (2013.01); G06T 2200/08 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20216 (2013.01); G06T 2207/20221 (2013.01); G06T 2207/30201 (2013.01); G06T 2210/56 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for constructing a three-dimensional (3D) facial mesh, performed by a computing device, the method comprising:
obtaining a facial point cloud of a target object;
generating a facial texture image of the target object from the facial point cloud and n face images corresponding to n head postures of the target object, n being a positive number;
performing grid downsampling on the facial point cloud to obtain a downsampled facial point cloud;
determining, through an expansion calculation, pixel coordinates on the facial texture image of the target object that correspond to 3D data points in the downsampled facial point cloud as index information of the 3D data points;
performing triangulation on pixels on the facial texture image to obtain triangulation information, the triangulation information being used for indicating triangular topologies corresponding to the pixels;
constructing an initial 3D facial mesh according to the triangulation information, the index information and the downsampled facial point cloud;
determining a non-core region in the initial 3D facial mesh, the non-core region being a non-facial region in the initial 3D facial mesh;
smoothing the non-core region in the initial 3D facial mesh to obtain a smoothed non-core region; and
replacing the non-core region in the initial 3D facial mesh with the smoothed non-core region to obtain a 3D facial mesh of the target object.