US 11,756,239 B2
Multi-modal image color segmenter and editor
Pranav Aggarwal, San Jose, CA (US); and Ajinkya Kale, San Jose, CA (US)
Assigned to ADOBE, INC., San Jose, CA (US)
Filed by ADOBE INC., San Jose, CA (US)
Filed on Apr. 26, 2021, as Appl. No. 17/240,030.
Prior Publication US 2022/0343561 A1, Oct. 27, 2022
Int. Cl. G06T 11/00 (2006.01); G06T 7/90 (2017.01); G06T 7/11 (2017.01)
CPC G06T 11/001 (2013.01) [G06T 7/11 (2017.01); G06T 7/90 (2017.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
generating color embeddings for a plurality of pixels of an image using a color encoder;
identifying a source color embedding corresponding to a source color within the image;
segmenting the image to produce a color segmentation by comparing the source color embedding to the pixel color embeddings, wherein the color segmentation indicates a portion of the image that corresponds to the source color;
receiving a target color input corresponding to a target color;
generating a target color embedding by applying a color text embedding network to the target color input;
identifying the target color based on the target color embedding; and
replacing the source color with the target color in the image based on the color segmentation and the target color embedding.