US 12,216,717 B1
Methods and systems for implementing large language models and smart caching with zero shot
Itay Margolin, Tel Aviv (IL); Eilon Sheetrit, Tel Aviv (IL); and Ido Joseph Farhi, Tel Aviv (IL)
Assigned to INTUIT INC., Mountain View, CA (US)
Filed by INTUIT INC., Mountain View, CA (US)
Filed on Mar. 20, 2024, as Appl. No. 18/611,549.
Int. Cl. G06F 16/93 (2019.01); G06F 12/0875 (2016.01)
CPC G06F 16/93 (2019.01) [G06F 12/0875 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A document classification system, comprising:
a large language model (LLM) configured to classify documents by identifying indicators in the documents;
a smart caching mechanism configured to store classifications of documents and associated indicators from the LLM;
a database containing document details, classifications, and associated indicators; and
a classification module configured to classify a new document by analyzing the new document for indicators and checking for a match in the cache based on the indicators, querying the database for the indicators when no match for the new document is found in the cache, and applying a majority vote based on the classifications associated with the indicators.