US 11,720,634 B2
Automatic generation of clarification questions for conversational search
Yosi Mass, Ramat Gan (IL); Haggai Roitman, Yoknea'm Elit (IL); and Doron Cohen, Gilon (IL)
Assigned to International Business Machines Corporation, Armonk, NY (US)
Filed by International Business Machines Corporation, Armonk, NY (US)
Filed on Mar. 9, 2021, as Appl. No. 17/195,673.
Prior Publication US 2022/0292139 A1, Sep. 15, 2022
Int. Cl. G06N 20/00 (2019.01); G06F 16/9032 (2019.01); G06F 40/30 (2020.01); G06F 40/279 (2020.01)
CPC G06F 16/90332 (2019.01) [G06F 40/279 (2020.01); G06F 40/30 (2020.01); G06N 20/00 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising the following automated steps:
obtaining multiple dialogs between users and agents, wherein:
each of the dialogs comprises messages exchanged between one of the users and one of the agents, and
one of the messages of each of the dialogs comprises a reference to a solution document provided by the respective agent;
for each of the dialogs, operating a search engine to retrieve a text passage, relevant to at least one of the messages of the respective dialog, from the respective solution document; and
training a machine learning language model to generate a new clarification question given at least one new message and a multiple new text passages, wherein the training is based on a training set which comprises, for each of the dialogs: said at least one of the messages of the respective dialog, and the text passage retrieved for the respective dialog.