CPC G06F 40/56 (2020.01) [G06F 40/205 (2020.01); G06F 40/30 (2020.01)] | 23 Claims |
1. A computer-implemented method of automatically removing hallucinations from natural language text generated by a large language model (LLM), including the steps of:
(a) providing a prompt or query to the LLM;
(b) automatically generating a baseline response to the prompt or query, the baseline response including factual assertions;
(c) automatically generating one or more verification questions to test the accuracy of one or more of the factual assertions for factual accuracy or inaccuracy;
(d) systematically answering the or each verification questions in a manner that is not dependent on the baseline response;
(e) using the answers to the or each verification question to identify one or more factual inaccuracies or hallucinations present in the baseline response;
(f) automatically using the or each answer to the verification question or questions to generate a final natural language output, in which one or more factual inaccuracies or hallucinations present in the baseline response, have been removed.
|