CPC G06T 17/205 (2013.01) [G06T 3/20 (2013.01); G06T 3/40 (2013.01); G06T 3/60 (2013.01); G06T 7/11 (2017.01); G06T 7/50 (2017.01); G06T 19/20 (2013.01); G06T 2219/2016 (2013.01)] | 30 Claims |
1. A method of processing one or more images, comprising:
obtaining a two-dimensional (2D) input image from a camera;
obtaining a three-dimensional (3D) representation of the 2D input image;
determining a first portion of the 3D representation of the 2D input image corresponding to a target object in the 2D input image;
obtaining an object mask associated with one or more additional objects, different from the target object, in the 2D input image, and wherein the determining the first portion of the 3D representation is based on the object mask;
determining, based on the object mask, a second portion of the 3D representation corresponding to at least one of the one or more additional objects; and
adjusting a pose of the first portion of the 3D representation and fixing one or more vertices of the second portion of the 3D representation to generate an adjusted 3D mesh;
generating a 2D output image having a modified version of the target object based on the adjusted pose of the first portion of the 3D representation of the 2D input image corresponding to the target object to be output on a display.
|