US 11,948,051 B2
System and method for ensuring that the results of machine learning models can be audited
Edward R. Wetherbee, Omaha, NE (US); Kenneth P. Baclawski, Waltham, MA (US); Guang C. Wang, San Diego, CA (US); Kenny C. Gross, Escondido, CA (US); Anna Chystiakova, San Francisco, CA (US); Dieter Gawlick, Palo Alto, CA (US); Zhen Hua Liu, San Mateo, CA (US); and Richard Paul Sonderegger, Dorchester, MA (US)
Assigned to ORACLE INTERNATIONAL CORPORATION, Redwood Shores, CA (US)
Filed by ORACLE INTERNATIONAL CORPORATION, Redwood Shores, CA (US)
Filed on Mar. 23, 2020, as Appl. No. 16/826,478.
Prior Publication US 2021/0295210 A1, Sep. 23, 2021
Int. Cl. G06F 16/00 (2019.01); G05B 23/02 (2006.01); G06F 17/16 (2006.01); G06F 17/18 (2006.01); G06F 30/27 (2020.01); G06N 20/00 (2019.01); G06F 111/10 (2020.01); G06N 3/08 (2023.01); G06N 20/10 (2019.01)
CPC G06N 20/00 (2019.01) [G05B 23/024 (2013.01); G06F 17/16 (2013.01); G06F 17/18 (2013.01); G06F 30/27 (2020.01); G06F 2111/10 (2020.01); G06N 3/08 (2013.01); G06N 20/10 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for auditing the results of a machine learning model, the method comprising:
retrieving a set of state estimates for original time series data values from a database under audit, wherein the each of the state estimates is generated by a state estimation computation for one of the time series data values;
reversing the state estimation computation for each of the state estimates to produce reconstituted time series data values for each of the state estimates;
retrieving the original time series data values from the database under audit;
comparing the original time series data values pairwise with the reconstituted time series data values to determine whether the original time series and reconstituted time series match; and
generating a signal that the database under audit (i) has not been modified where the original time series and reconstituted time series match, and (ii) has been modified where the original time series and reconstituted time series do not match.