US 12,333,627 B2
Artificial intelligence-based image generation method, device and apparatus, and storage medium
Xiaohang Ren, Shenzhen (CN); Yang Ding, Shenzhen (CN); Xiao Zhou, Shenzhen (CN); Youcheng Ben, Shenzhen (CN); Yuxuan Yan, Shenzhen (CN); Pei Cheng, Shenzhen (CN); and Gang Yu, Shenzhen (CN)
Assigned to TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, Shenzhen (CN)
Filed by Tencent Technology (Shenzhen) Company Limited, Shenzhen (CN)
Filed on Apr. 11, 2022, as Appl. No. 17/718,164.
Application 17/718,164 is a continuation of application No. PCT/CN2021/091825, filed on May 6, 2021.
Claims priority of application No. 202010467388.1 (CN), filed on May 28, 2020.
Prior Publication US 2022/0237829 A1, Jul. 28, 2022
Int. Cl. G06T 11/00 (2006.01); G06T 7/73 (2017.01); G06V 10/40 (2022.01)
CPC G06T 11/00 (2013.01) [G06T 7/73 (2017.01); G06V 10/40 (2022.01); G06T 2207/10016 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30196 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An artificial intelligence-based image generation method performed by a computer device, the method comprising:
acquiring a 2D source image and a 2D target image, the 2D source image comprising a target object whose pose is to be transformed, and the 2D target image comprising a reference object presenting a target pose, wherein the reference object is different from the target object;
determining a 3D pose transition matrix according to a 3D model pose corresponding to the to-be-transformed pose of the target object and a 3D model pose corresponding to the target pose of the reference object;
extracting, as a 3D basic appearance feature, an appearance feature of the target object from the 2D source image;
processing the 3D basic appearance feature based on the 3D pose transition matrix, to obtain a 3D target appearance feature of the target object in the target pose;
generating a 2D target synthetic image of the target object in the target pose based on the 3D target appearance feature; and
outputting the 2D target synthetic image on a display of the computer device.