US 12,106,191 B2
Continuous learning process using concept drift monitoring
Rafal Bigaj, Cracow (PL); Wojciech Sobala, Cracow (PL); Lukasz G. Cmielowski, Cracow (PL); and Maksymilian Erazmus, Zasów (PL)
Assigned to International Business Machines Corporation, Armonk, NY (US)
Filed by International Business Machines Corporation, Armonk, NY (US)
Filed on Feb. 25, 2021, as Appl. No. 17/185,666.
Prior Publication US 2022/0269984 A1, Aug. 25, 2022
Int. Cl. G06N 20/00 (2019.01); G06F 11/34 (2006.01); G06F 18/214 (2023.01)
CPC G06N 20/00 (2019.01) [G06F 11/3452 (2013.01); G06F 18/2155 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A method for predicting a performance of a machine learning module (ML-Module), the method comprising:
detecting a change in performance of an ML-Module over a period of time using a labeled input dataset for the ML-Module, a target value for the ML-Module, and an output value of the ML-Module, the output value being generated using the labeled input dataset with the ML-Module, the labeled input dataset being provided individually to the ML-Module over the period of time;
detecting a change in predicted performance of the ML-Module over the period of time by a drift module, the drift module being configured to compute a single value of the predicted performance using each input dataset of a set of input datasets, the input datasets of the set of input datasets being provided individually to the drift module over the period of time;
determining a value of a first key figure, the value of the first key figure indicating a correlation between the change in performance of the ML-Module and the change in predicted performance of the ML-Module; and
providing a signal that indicates the value of the first key figure.