US 12,292,976 B2
Risk evaluation apparatus, risk evaluation method, and non-transitory computer-readable recording medium
Rina Okada, Musashino (JP); and Satoshi Hasegawa, Musashino (JP)
Assigned to NIPPON TELEGRAPH AND TELEPHONE CORPORATION, Tokyo (JP)
Appl. No. 17/782,195
Filed by NIPPON TELEGRAPH AND TELEPHONE CORPORATION, Tokyo (JP)
PCT Filed Jan. 14, 2020, PCT No. PCT/JP2020/000862
§ 371(c)(1), (2) Date Jun. 3, 2022,
PCT Pub. No. WO2021/144841, PCT Pub. Date Jul. 22, 2021.
Prior Publication US 2023/0004647 A1, Jan. 5, 2023
Int. Cl. G06F 21/57 (2013.01); G06N 20/00 (2019.01)
CPC G06F 21/57 (2013.01) [G06N 20/00 (2019.01)] 11 Claims
OG exemplary drawing
 
1. A risk evaluation apparatus for evaluating a risk of a machine learning model, the risk evaluation apparatus comprising:
a recording medium configured to record a set of loss functions that are predetermined and a set of a plurality of pairs of data and labels that are predetermined; and
processing circuitry configured to:
execute a loss function regression model acquirer process which determines, for each of the loss functions and for each of the plurality of pairs of data and labels, a regression model of the loss function in a vicinity of the data by nonparametric regression;
execute an attack noise addition process which creates attack data using the regression model for each of the loss functions and for each of the plurality of pairs of data and labels;
execute an error acquisition process which obtains a set of errors, each of which is an error between an output of the machine learning model in a case where the data recorded in the recording medium is input and an output of the machine learning model in a case where the attack data is input for each of the loss functions and for each of the plurality of pairs of data and labels; and
execute an evaluation process which evaluates a risk based on the set of errors.