| CPC G06F 21/566 (2013.01) [G06F 2221/034 (2013.01)] | 28 Claims |
|
1. A computer-implemented method comprising:
receiving, from a requestor, a prompt for ingestion by a first generative artificial intelligence (GenAI) model, the first GenAI model executing in a model computing environment;
redirecting, by a proxy executing in the model environment, the prompt prior to ingestion by the first GenAI model so as to initially be input into a second GenAI model to receive a second output, the first GenAI model being different than the second GenAI model, the second GenAI model executing in a monitoring computing environment separate and distinct from the model computing environment;
determining whether the second output indicates that guardrails associated with the second GenAI model have been triggered;
initiating one or more remediation actions in response to the determination that the second output indicates that the guardrails associated with the second GenAI model have been triggered, the one or more remediation actions preventing the prompt as received from being ingested by the first GenAI model; and
inputting the prompt into the first GenAI model in response to the determination that the second output indicates that guardrails associated with the second GenAI model have not been triggered to result in a first output and returning the first output to the requestor.
|