| CPC G06T 17/20 (2013.01) [G06T 15/06 (2013.01); G06T 15/205 (2013.01)] | 10 Claims |
|
1. A mesh reconstruction method for a transparent object, comprising:
acquiring object images of the transparent object at multiple capture view angles and calibration information corresponding to an image capture device, the image capture device being configured to capture the object images;
generating an initial mesh model corresponding to the transparent object according to the object images acquired at the multiple capture view angles;
determining a light ray refraction loss corresponding to an emergent light ray of the image capture device according to the calibration information, and determining a model loss corresponding to the initial mesh model according to the light ray refraction loss; and
reconstructing the initial mesh model according to the model loss, to obtain a target mesh model corresponding to the transparent object;
wherein the generating the initial mesh model corresponding to the transparent object according to the object images acquired at the multiple capture view angles comprises:
extracting a plurality of contour images corresponding to the transparent object from the object images acquired at the multiple capture view angles;
performing space carving according to the plurality of contour images, to obtain a three-dimensional convex hull corresponding to the transparent object; and
acquiring a target mesh parameter and meshing the three-dimensional convex hull according to the target mesh parameter, to obtain the initial mesh model corresponding to the transparent object;
the mesh reconstruction method further comprising:
acquiring projection contours of the initial mesh model at the multiple capture view angles; and
determining an object contour loss corresponding to the initial mesh model according to a coincidence degree of a projection contour and a corresponding contour image;
wherein the determining the model loss corresponding to the initial mesh model according to the light ray refraction loss comprises:
acquiring a light ray refraction weight corresponding to the light ray refraction loss and a contour weight corresponding to the object contour loss; and
weighting the light ray refraction loss and the object contour loss according to the light ray refraction weight and the contour weight, to obtain the model loss corresponding to the initial mesh model.
|