US 12,093,319 B2
Measuring quality of a chatbot response
Piotr Kalandyk, Zielonki (PL); Grzegorz Piotr Szczepanik, Cracow (PL); Hubert Kompanowski, Izbica Kujawska (PL); and Agnieszka Tkaczyk-Walczak, Cracow (PL)
Assigned to International Business Machines Corporation, Armonk, NY (US)
Filed by INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US)
Filed on Mar. 4, 2021, as Appl. No. 17/249,522.
Prior Publication US 2022/0284059 A1, Sep. 8, 2022
Int. Cl. G06F 16/9032 (2019.01); G06F 16/906 (2019.01); G06F 16/908 (2019.01); G06F 18/21 (2023.01)
CPC G06F 16/90332 (2019.01) [G06F 16/906 (2019.01); G06F 16/908 (2019.01); G06F 18/217 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for measuring a quality of a chatbot response, the computer-implemented method comprising:
receiving one or more classifications;
receiving a set of questions in a chatbot to be analyzed;
filtering any question from the received set of questions that is not related to an area of expertise of the chatbot;
matching at least two questions from the received set of questions to each other; and
applying at least one of the one or more classifications to the at least two matched questions.