US 12,462,095 B2
Dynamic construction of large language model prompts
Abed El Kader Asi, Sammamish, WA (US); Alexander Tsvetkov, Tel Aviv (IL); Royi Ronen, Tel Aviv (IL); Yarin Kuper, Tel Aviv (IL); Shahar Zvi Keren, Hemed (IL); and Roy Eisenstadt, Tel Aviv (IL)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Apr. 13, 2023, as Appl. No. 18/299,842.
Prior Publication US 2024/0346232 A1, Oct. 17, 2024
Int. Cl. G06F 40/166 (2020.01); G06F 40/40 (2020.01)
CPC G06F 40/166 (2020.01) [G06F 40/40 (2020.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
a processor; and
a computer-readable medium storing instructions that are operative upon execution by the processor to:
receiving a transcript of a conversation between participants;
generate a summary of the transcript using a summarization model, the summary relating to a topic of the conversation;
extract topic-specific data associated with the topic from a customer relations management (CRM) or enterprise suite data set using a scoring model, the CRM or enterprise data set excluding the transcript;
dynamically generate a large language model (LLM) prompt based on the summary by resolving a difference between the topic-specific data and the summary in favor of the topic-specific data; and
generate, by an LLM model, an output text based on the LLM prompt.