US 12,260,530 B2
Generating a modified digital image utilizing a human inpainting model
Krishna Kumar Singh, San Jose, CA (US); Yijun Li, Seattle, WA (US); Jingwan Lu, Santa Clara, CA (US); Duygu Ceylan Aksit, Mountain View, CA (US); Yangtuanfeng Wang, London (GB); Jimei Yang, Merced, CA (US); Tobias Hinz, Ulm (DE); Qing Liu, Santa Clara, CA (US); Jianming Zhang, Campbell, CA (US); and Zhe Lin, Fremont, CA (US)
Assigned to Adobe Inc., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on Mar. 27, 2023, as Appl. No. 18/190,544.
Application 18/190,544 is a continuation in part of application No. 18/058,538, filed on Nov. 23, 2022.
Application 18/190,544 is a continuation in part of application No. 18/058,601, filed on Nov. 23, 2022.
Application 18/190,544 is a continuation in part of application No. 18/058,554, filed on Nov. 23, 2022.
Claims priority of provisional application 63/378,616, filed on Oct. 6, 2022.
Prior Publication US 2024/0135511 A1, Apr. 25, 2024
Int. Cl. G06T 5/00 (2024.01); G06T 5/77 (2024.01); G06V 10/25 (2022.01); G06V 10/44 (2022.01); G06V 10/82 (2022.01)
CPC G06T 5/77 (2024.01) [G06V 10/25 (2022.01); G06V 10/44 (2022.01); G06V 10/82 (2022.01); G06T 2207/30196 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
one or more memory devices comprising a digital image, a structure guidance map of a human, a parameter neural network, and a human inpainting generative adversarial neural network; and
one or more processors configured to cause the system to:
determine a human portrayed in the digital image and a region of the human to inpaint;
generate, utilizing an encoder, a structural encoding from the structure guidance map of the human;
generate, utilizing the encoder, a visual appearance encoding of the human;
generate, utilizing the parameter neural network, local appearance feature tensor from the visual appearance encoding; and
generate, utilizing a human inpainting generative adversarial neural network, a modified digital image comprising modified pixels of the region from the structural encoding and the local appearance feature tensor.