| CPC G06N 5/022 (2013.01) [G06F 16/908 (2019.01); G06F 18/2115 (2023.01); G06F 40/44 (2020.01); G06N 5/045 (2013.01); G06N 20/00 (2019.01); G06Q 10/0633 (2013.01)] | 15 Claims |
|
1. A method implemented by a modeling system and comprising:
detecting one or more unexpected scores during validation of a model before deploying the model in a production environment, comprising:
comparing a validation distribution of scores with a reference distribution of scores, wherein the validation distribution of scores is generated by the model for a validation input data set and the reference distribution of scores is generated by the model for a test input data set;
determining whether an alert condition is satisfied based on a shift of a plurality of median model score values in the validation distribution of scores, wherein the shift is identified based on the comparison; and
providing an alert when the alert condition is determined to be satisfied, wherein the alert indicates detection of the one or more unexpected scores.
|