US 12,463,883 B2
Method for monitoring performance of an artificial intelligence (AI)/machine learning (ML) model or algorithm
Pablo Soldati, Solna (SE); and Luca Lunardi, Genoa (IT)
Assigned to Telefonaktiebolaget LM Ericsson (publ), Stockholm (SE)
Appl. No. 18/290,783
Filed by Telefonaktiebolaget LM Ericsson (publ), Stockholm (SE)
PCT Filed Aug. 5, 2022, PCT No. PCT/EP2022/072152
§ 371(c)(1), (2) Date Jan. 21, 2024,
PCT Pub. No. WO2023/012359, PCT Pub. Date Feb. 9, 2023.
Claims priority of provisional application 63/229,734, filed on Aug. 5, 2021.
Prior Publication US 2024/0243984 A1, Jul. 18, 2024
Int. Cl. G06F 15/173 (2006.01); H04L 41/16 (2022.01); H04L 43/08 (2022.01)
CPC H04L 43/08 (2013.01) [H04L 41/16 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method performed by a first network node in a radio communication network to monitor the performance of an Artificial Intelligence, AI,/Machine Learning, ML, model or algorithm, the method comprising:
sending at least one first message to a second network node of the radio communication network, the at least one first message comprising a subscription request to obtain from the second network node one or more historical data elements associated with the AI/ML model or algorithm;
receiving at least one second message from the second network node, the at least one second message comprising one or more historical data elements associated with the AI/ML model or algorithm to be monitored by the first network node; and
determining at least one performance metric associated with the AI/ML model or algorithm to be monitored based on the one or more historical data elements associated with the AI/ML model;
wherein:
the first network node hosts a model training function of the AI/ML model or algorithm to be monitored;
the second network node hosts a data collection function of an AI/ML model or algorithm; and
a third network node hosts a model inference function of the AI/ML model or algorithm.