US 11,928,778 B2
Method for human body model reconstruction and reconstruction system
Zhong Li, Palo Alto, CA (US); Yi Xu, Palo Alto, CA (US); and Shuxue Quan, Palo Alto, CA (US)
Assigned to GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD., Guangdong (CN)
Filed by GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD., Guangdong (CN)
Filed on Mar. 29, 2022, as Appl. No. 17/707,681.
Application 17/707,681 is a continuation of application No. PCT/CN2020/117916, filed on Sep. 25, 2020.
Claims priority of provisional application 62/908,314, filed on Sep. 30, 2019.
Prior Publication US 2022/0222895 A1, Jul. 14, 2022
Int. Cl. G06T 17/20 (2006.01); G06T 7/11 (2017.01); G06T 19/20 (2011.01)
CPC G06T 17/20 (2013.01) [G06T 7/11 (2017.01); G06T 19/20 (2013.01); G06T 2207/30201 (2013.01); G06T 2219/2004 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for human body model reconstruction, comprising:
acquiring a target image, and acquiring a segmented image by segmenting the target image based on an object to be reconstructed in the target image, the target image being one front image of the object;
acquiring an initial estimate shape and a part of texture information of the object, according to the segmented image;
determining an initial 3D model of the object through the initial estimate shape, the initial 3D model being a 3D model without texture;
acquiring complete texture information of the object according to the part of texture information and a texture generation model; and
generating a 3D reconstruction model of the object based on the initial 3D model and the complete texture information, the 3D reconstruction model being a 3D model with texture,
wherein the determining an initial 3D model of the object through the initial estimate shape comprises:
acquiring a first silhouette of the object;
correcting the initial estimate shape according to the first silhouette, and generating a front model and a back model of the object; and
stitching the front model and the back model, and generating the initial 3D model,
wherein the correcting the initial estimate shape according to the first silhouette, and generating a back model of the object comprises:
rendering the initial estimate shape and acquiring a back estimate shape of the object;
determining a third silhouette of the back estimate shape;
determining a second mapping relationship between the first silhouette and the third silhouette; and
generating the back model based on the second mapping relationship.