US 11,699,071 B2
Evaluating surrogate machine learning models
Lukasz G. Cmielowski, Cracow (PL); Wojciech Sobala, Cracow (PL); Rafal Bigaj, Cracow (PL); and Maksymilian Erazmus, Zasów (PL)
Assigned to International Business Machines Corporation, Armonk, NY (US)
Filed by International Business Machines Corporation, Armonk, NY (US)
Filed on Nov. 20, 2019, as Appl. No. 16/689,414.
Prior Publication US 2021/0150336 A1, May 20, 2021
Int. Cl. G06N 3/08 (2023.01); G06N 3/04 (2023.01); G06N 5/022 (2023.01)
CPC G06N 3/08 (2013.01) [G06N 3/04 (2013.01); G06N 5/022 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for evaluating machine learning model quality, the method comprising:
processing, by a first machine learning model, a set of inputs to generate a first set of results;
calculating, based on the first set of results, a quality control range;
calculating, by a second machine learning model, a mean accuracy of a second set of results, based on the set of inputs;
determining whether the mean accuracy of the second set of results is within the quality control range; and
notifying a user of the determination.