US 12,455,895 B2
Artificial intelligence model surveillance system
Bin He, Philadelphia, PA (US); Wei Geng, San Diego, CA (US); Jon Arthur Wierks, Tustin, CA (US); Kien Trong Trinh, San Diego, CA (US); Mark A. Spieckerman, Dana Point, CA (US); Sankar Bokka, Oxford, MS (US); Bryan Byron Craver, San Diego, CA (US); Roderick Maclan, San Diego, CA (US); and Tricia J. Murray, San Diego, CA (US)
Assigned to CoreLogic Solutions, LLC, Irvine, CA (US)
Filed by CoreLogic Solutions, LLC, Irvine, CA (US)
Filed on Oct. 10, 2023, as Appl. No. 18/484,323.
Application 18/484,323 is a continuation of application No. 16/912,441, filed on Jun. 25, 2020, granted, now 11,816,122.
Prior Publication US 2024/0037116 A1, Feb. 1, 2024
Int. Cl. G06F 16/00 (2019.01); G06F 16/21 (2019.01); G06F 16/25 (2019.01); G06N 20/20 (2019.01); G06Q 50/16 (2012.01)
CPC G06F 16/256 (2019.01) [G06F 16/217 (2019.01); G06N 20/20 (2019.01); G06Q 50/16 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
obtaining model data input to a first machine learning model in a plurality of machine learning models used in a property valuation workflow or output from the first machine learning model;
applying the model data as an input to at least one of a plurality of machine learning anomaly detection models, wherein the at least one of the plurality of machine learning anomaly detection models is different than the first machine learning model;
detecting an anomaly in the model data applied as the input to the at least one of the plurality of machine learning anomaly detection models based on an output of the at least one of the plurality of machine learning anomaly detection models;
generating a suggestion to modify at least some of the model data based on a profile associated with the detected anomaly, wherein the suggestion comprises an identification of the detected anomaly;
presenting the suggestion to a user for review;
modifying the at least some of the model data in accordance with the generated suggestion; and
re-training the first machine learning model using the modified at least some of the model data.