US 12,340,406 B2
Combining vectors output by multiple different mechanisms for content item retrieval
Eric McVoy Dodds, Berkeley, CA (US); Benjamin Jackson Culpepper, Berkeley, CA (US); and Gaurav Srivastava, San Francisco, CA (US)
Assigned to Yahoo Ad Tech LLC, New York, NY (US)
Filed by Yahoo Ad Tech LLC, Wilmington, DE (US)
Filed on Jul. 28, 2022, as Appl. No. 17/875,484.
Prior Publication US 2024/0037627 A1, Feb. 1, 2024
Int. Cl. G06Q 30/00 (2023.01); G06Q 30/0601 (2023.01)
CPC G06Q 30/0627 (2013.01) [G06Q 30/0603 (2013.01); G06Q 30/0643 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
executing, on a processor of a computing device, instructions that cause the computing device to perform operations, the operations comprising:
generating, using an image encoder, a first set of vectors generated by an image model using an input image of a first object as input;
generating, using a text encoder, a second set of vectors generated by a text model using input text of a modification to the first object in the input image as input;
combining, using a vector combination module, (i) the first set of vectors of the input image of the first object and (ii) the second set of vectors of the input text of the modification to the first object to create a vector output;
applying a weight to the vector output to create a weighted output;
generating an output vector based upon a combination of the first set of vectors, the second set of vectors, and the weighted output;
using the output vector to determine a modified object indicative of the first object in the input image being modified by the input text; and
providing a content item comprising the modified object to a device for display.