US 12,452,287 B2
Blockchain enabled large language model red teaming
Hiranmayi Palanki, Tampa, FL (US); and Shankar Djeyassilane, Markham (CA)
Assigned to AMERICAN EXPRESS TRAVEL RELATED SERVICES COMPANY, INC., New York, NY (US)
Filed by American Express Travel Related Services Company, Inc., New York, NY (US)
Filed on Nov. 15, 2023, as Appl. No. 18/510,400.
Prior Publication US 2025/0159014 A1, May 15, 2025
Int. Cl. H04L 9/40 (2022.01); H04L 9/00 (2022.01)
CPC H04L 63/1433 (2013.01) [H04L 9/50 (2022.05)] 20 Claims
OG exemplary drawing
 
1. A system, comprising:
at least one computing device comprising at least one processor and at least one memory; and
machine-readable instructions stored in the at least one memory that, when executed by the at least one processor, cause the at least one computing device to at least:
execute, in a distributed ledger environment, a large language model (LLM) red teaming management agent that initiates a security analysis of an LLM by deploying a plurality of subsidiary agents in the distributed ledger environment, wherein the subsidiary agents perform actions for the security analysis of the LLM;
execute an LLM red teaming agent of the plurality of subsidiary agents, wherein the LLM red teaming agent transmits a request for a network service to perform an LLM red teaming action for the security analysis of the LLM, and the LLM red teaming agent receives an LLM red teaming result of the LLM red teaming action; and
execute an LLM evaluation agent of the plurality of subsidiary agents, wherein the LLM evaluation agent evaluates the LLM red teaming result to generate endorsement status information for the LLM.