US 12,217,459 B2
Multimodal color variations using learned color distributions
Vineet Batra, Delhi (IN); Sumit Dhingra, Delhi (IN); Matthew Fisher, San Carlos, CA (US); and Ankit Phogat, Uttar Pradesh (IN)
Assigned to Adobe Inc., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on Jun. 25, 2021, as Appl. No. 17/359,221.
Prior Publication US 2022/0414936 A1, Dec. 29, 2022
Int. Cl. G06T 7/90 (2017.01); G06N 3/04 (2023.01)
CPC G06T 7/90 (2017.01) [G06N 3/04 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
obtaining, by a user interface manager, an input image;
determining, by a color extraction manager, one or more color priors based on the input image;
encoding the one or more color priors into an input tensor that represents color space values and weight values associated with each of the one or more color priors;
predicting, by a color distribution modeling network, a color space value of a color of a color theme variation, wherein the color is based on the one or more color priors, wherein the color distribution modeling network has been trained to model a color distribution of a training dataset, the training dataset including a plurality of color images having different color themes;
generating, by the color distribution modeling network, a plurality of color theme variations by iteratively predicting one or more colors of each color theme variation of the plurality of color theme variations;
ranking, by a color theme evaluation network, the plurality of color theme variations to obtain a plurality of ranked color theme variations; and
recoloring, by a recolor manager, the input image to generate a plurality of recolored output images using a number of top ranked color theme variations of the plurality of ranked color theme variations, wherein recoloring includes changing pixel color values of the input image according to the plurality of color theme variations.