CPC G10L 15/16 (2013.01) [G10L 15/063 (2013.01); G10L 15/08 (2013.01); G10L 15/22 (2013.01); H04L 51/02 (2013.01); G06F 16/3344 (2019.01); G06F 40/56 (2020.01)] | 20 Claims |
1. A computer-implemented method, comprising:
receiving a sequence of utterances representing a context in an online conversation, the sequence comprising one or more utterances;
generating a context vector by:
generating one or more utterance vectors by providing the one or more utterances to an utterance vector generator comprising a multilingual neural network;
generating one or more encoded utterance vectors comprising, for each of the one or more utterance vector: adding a user embedding of the user performing the conversation to the utterance vector to generate a combined vector and providing the combined vector as input to a transformer encoder; and
aggregating the one or more encoded utterance vectors to obtain a context vector;
accessing one or more candidate responses for the online conversation;
determining distance scores for the candidate responses by:
generating a response vector for the candidate response using the utterance vector generator; and
combining the response vector with the context vector to obtain the distance score;
selecting a response based on the distance scores of the candidate responses; and
providing the selected response to the user via the online conversation.
|