US 11,790,411 B1
Complaint classification in customer communications using machine learning models
Thomas Mann, Charlotte, NC (US); Michael W. Soistman, Charlotte, NC (US); Nathan R Parrish, Chaska, MN (US); Noel P. Volin, Hudson, WI (US); Raja Ranganathan, Cary, NC (US); Dane Arnesen, Saint Louis Park, MN (US); Shawn Bocketti, San Francisco, CA (US); Kevin Portis, San Francisco, CA (US); and Josh Engebretson, Charlotte, NC (US)
Assigned to Wells Fargo Bank, N.A., San Francisco, CA (US)
Filed by Wells Fargo Bank, N.A., San Francisco, CA (US)
Filed on Feb. 4, 2020, as Appl. No. 16/781,620.
Claims priority of provisional application 62/941,950, filed on Nov. 29, 2019.
Int. Cl. G06F 40/284 (2020.01); G06N 20/00 (2019.01); G06Q 30/02 (2023.01); G06Q 30/00 (2023.01); G10L 15/22 (2006.01); G10L 15/26 (2006.01); G06Q 30/016 (2023.01); G06Q 30/01 (2023.01)
CPC G06Q 30/0281 (2013.01) [G06F 40/284 (2020.01); G06N 20/00 (2019.01); G06Q 30/01 (2013.01); G06Q 30/016 (2013.01); G10L 15/26 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computing system comprising:
a memory; and
one or more processors in communication with the memory and configured to:
receive data indicative of a message from a user device, wherein the data indicative of the message comprises a string of characters;
receive, from an agent device, a risk classification corresponding to the message, wherein the risk classification:
classifies the message as a first risk level indicating that the message is to be elevated; or
classifies the message as a second risk level indicating that the message is not to be elevated, wherein the first risk level is greater than the second risk level;
identify, based on the string of characters, a set of token vectors from a plurality of token vectors generated based on a set of training data;
determine, using a machine learning model and based on the set of token vectors, a probability that a risk level associated with the message is the first risk level; and
determine whether the risk classification from the agent device is correct based on the probability that the risk level associated with the message is the first risk level.