US 12,230,014 B2
User-guided image generation
Yijun Li, Seattle, WA (US); Utkarsh Ojha, Madison, WI (US); Richard Zhang, San Francisco, CA (US); Jingwan Lu, Sunnyvale, CA (US); Elya Shechtman, Seattle, WA (US); and Alexei A. Efros, San Jose, CA (US)
Assigned to ADOBE INC., San Jose, CA (US)
Filed by ADOBE INC., San Jose, CA (US)
Filed on Feb. 25, 2022, as Appl. No. 17/680,906.
Prior Publication US 2023/0274535 A1, Aug. 31, 2023
Int. Cl. G06V 10/774 (2022.01); G06F 3/04842 (2022.01)
CPC G06V 10/7747 (2022.01) [G06F 3/04842 (2013.01)] 20 Claims
OG exemplary drawing
 
8. A computerized method comprising:
receiving a source generative model for a source domain and a set of training images for a target domain;
adapting the source generative model using the set of training images to provide an adapted generative model for the target domain;
determining a plurality of interpretable factors for the source generative model and/or the adapted generative model, each interpretable factor comprising a direction in a latent space of the source generative model and/or a direction in a latent space of the adapted generative model;
receiving input regarding a user-selected interpretable factor from the plurality of interpretable factors, the user-selected interpretable factor corresponding to a first subset of weights in a weight matrix for the source generative model;
generating a user-adapted generative model for the target domain based on the user-selected interpretable factor by training the user-adapted generative model using a loss function minimizing a distance between the first subset of weights in the weight matrix for the source generative model and a corresponding first subset of weights in a weight matrix for the user-adapted generative model; and
using the user-adapted generative model to generate a new image in the target domain.