US 11,861,513 B2
Methods for detecting and monitoring bias in a software application using artificial intelligence and devices thereof
Kazuki Sekiguchi, Tokyo (JP); Fumihiko Terui, Tokyo (JP); and Pinaki Chandra Dey, Tokyo (JP)
Assigned to International Business Machines Corporation, Armonk, NY (US)
Filed by International Business Machines Corporation, Armonk, NY (US)
Filed on Jul. 13, 2020, as Appl. No. 16/927,501.
Prior Publication US 2022/0012610 A1, Jan. 13, 2022
Int. Cl. G06N 5/04 (2023.01); G06F 11/34 (2006.01); G06N 20/00 (2019.01)
CPC G06N 5/04 (2013.01) [G06F 11/34 (2013.01); G06N 20/00 (2019.01)] 22 Claims
OG exemplary drawing
 
1. A method for monitoring and detecting bias in an application, the method comprising:
indexing, by a bias monitoring computing system, training data;
obtaining, by the bias monitoring computing system, a plurality of correlation values of one or more features in the indexed training data with a target variable; and
for each of the one or more features:
calculating, by the bias monitoring computing system, a first value of correlation of the plurality of correlation values of the one of the one or more features and a favorable result of a judgement by a trained artificial intelligence model;
calculating, by the bias monitoring computing system, a second value of correlation of the plurality of correlation values of the one of the one or more features and a unfavorable result of a judgement by the trained artificial intelligence model;
calculating, by the bias monitoring computing system, an absolute value of a difference between the calculated first value and the calculated second value;
calculating, by the bias monitoring computing system, a total sum of the calculated absolute value of the plurality of correlation values of the one of the one or more features; and
identifying and monitoring, by the bias monitoring computing system, a bias in the one or more features using the calculated first value, the second value, the absolute value, and the total sum.