US 11,928,853 B2
Techniques to perform global attribution mappings to provide insights in neural networks
Mark Ibrahim, Brooklyn, NY (US); John Paisley, New York, NY (US); Ceena Modarres, Brooklyn, NY (US); and Melissa Louie, Brooklyn, NY (US)
Assigned to Capital One Services, LLC, McLean, VA (US)
Filed by Capital One Services, LLC, McLean, VA (US)
Filed on Nov. 18, 2022, as Appl. No. 17/990,050.
Application 17/990,050 is a continuation of application No. 16/855,685, filed on Apr. 22, 2020, granted, now 11,568,263.
Claims priority of provisional application 62/970,652, filed on Feb. 5, 2020.
Prior Publication US 2023/0267332 A1, Aug. 24, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 10/762 (2022.01); G06F 18/23213 (2023.01); G06N 3/04 (2023.01); G06N 3/084 (2023.01)
CPC G06V 10/763 (2022.01) [G06F 18/23213 (2023.01); G06N 3/04 (2013.01); G06N 3/084 (2013.01)] 24 Claims
OG exemplary drawing
 
17. A computing apparatus comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the processor to:
determine local attributions for a set of samples, and each local attribution includes a rank and a weight of an association between a particular feature and a particular prediction predicted by a neural network;
normalize each local attribution;
compare pairs of local attributions, and assigning a rank distance thereto proportional to a degree of ranking differences between the pair of normalized local attributions;
apply a clustering algorithm to generate clusters of the local attributions, wherein the clustering algorithm utilizes the ranking distances for each pair of normalized local attributions to assign each local attribution to one of one or more clusters, and each cluster having a medoid;
generate global attributions, wherein each global attribution corresponds to one of the medoids of one of the clusters; and
determine a bias in the neural network, one or more features to include in the neural network, or a combination thereof based on the global attributions.