US 12,405,946 B1
Automatic query generation for large language models
Nachiketa Mishra, San Francisco, CA (US); Siva Kumar Reddy Vayyeti, Solon, OH (US); and Ravi Agrawal, Bangalore (IN)
Assigned to Salesforce, Inc., San Francisco, CA (US)
Filed by Salesforce, Inc., San Francisco, CA (US)
Filed on Feb. 15, 2024, as Appl. No. 18/442,736.
Int. Cl. G06F 16/242 (2019.01); G06F 16/2457 (2019.01); G06N 3/0455 (2023.01)
CPC G06F 16/243 (2019.01) [G06F 16/24578 (2019.01); G06N 3/0455 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
determining a first representation for an entity that received a request;
searching second representations in a prompt store to retrieve a second representation that is determined to match the first representation, wherein a prompt template for a model is associated with the second representation, and wherein the prompt template includes information for the entity that is used to cause the response to be in an entity voice for the entity that defines characteristics for a personality that is associated with the entity;
searching for relevant documents for the request in a knowledge base store;
retrieving information from a document that is considered relevant to the request, wherein the information provides context for the request;
inserting at least a portion of the information into the prompt template to generate a prompt that is based on the context;
submitting the prompt to the model to receive a response, wherein the response is in the entity voice based on providing the information for the entity voice to the model in the prompt; and
responding to the request using the response.