| CPC G06T 17/20 (2013.01) [G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06T 2207/20084 (2013.01); G06T 2207/30196 (2013.01)] | 26 Claims |
|
1. A processor-implemented method with three-dimensional (3D) modeling of a wearer of a wearable device, comprising:
generating a feature map for each of a plurality of images of the wearer obtained from a plurality of imaging devices provided in the wearable device;
obtaining joint keypoint information corresponding to joint positions of the wearer and initial shape coefficient information associated with a shape of the wearer based on the feature map, for each of the images, wherein the joint keypoint information comprises two-dimensional (2D) pixel information and depth information;
determining a target 3D joint angle for 3D modeling of the wearer based on the joint keypoint information and the initial shape coefficient information;
determining target shape coefficient information for 3D modeling of the wearer based on the joint keypoint information and the initial shape coefficient information; and
obtaining a 3D mesh of the wearer based on the target 3D joint angle and the target shape coefficient information,
wherein the obtaining of the initial shape coefficient information includes obtaining the initial shape coefficient through a performed regression only on the feature map of a first frame.
|