| CPC G06N 20/10 (2019.01) [G06F 18/214 (2023.01); G06F 18/2178 (2023.01); G06N 20/00 (2019.01)] | 7 Claims |
|
1. A learning model management system that uses a learning model to estimate information to be provided to a user based on user information of the user and to evaluate performance of the learning model, comprising:
a memory storing instructions; and
a processor executing the instructions causing the learning model management system to:
receive an input for specifying a number of feedback data required for performing a definite performance evaluation of the learning model;
perform the definite performance evaluation of the learning model when a number of feedback data from a providing destination exceeds a first threshold which is the specified number of feedback data;
perform relearning of the learning model when a deterioration of the performance of the learning model is detected as a result of the definite performance evaluation of the learning model;
perform a provisional performance evaluation of the learning model when the number of feedback data from the providing destination does not exceed the first threshold and exceeds a second threshold smaller than the first threshold based on the specified number of feedback data; and
provide a notification corresponding to the deterioration of the performance when the deterioration of the performance of the learning model has been detected based on result from the provisional performance evaluation performed a plurality of times,
wherein the notification is for requesting an administrator of the learning model management system to collect the first threshold number of feedback data from the providing destination.
|