CPC G06F 40/40 (2020.01) [G06F 40/30 (2020.01)] | 20 Claims |
1. A method for maintaining consistent results in an artificial intelligence (“AI”) pipeline, comprising:
submitting, by a prompt engine, a first sequence of content queries to a pipeline engine for the AI pipeline, wherein the AI pipeline includes a prompt package and a language model, and wherein the prompt package and at least a portion of the first sequence of content queries are inputs to the language model;
receiving first results from the AI pipeline in response to the first sequence;
in an instance subsequent to receiving the results from the AI pipeline, submitting, by the prompt engine, the first sequence of content queries to the pipeline;
receiving second results from the AI pipeline;
vectorizing the first and second results;
semantically comparing the vectorized first results and the vectorized second results;
identifying a semantic divergence by determining that the first results and the second results differ semantically more than a predetermined threshold amount; and
in response to the determination, performing a corrective action.
|