US 12,468,930 B2
Quantization method of artificial neural network and operation method using artificial neural network
Juhee Park, Gwacheon-si (KR); Kyoungyoung Kim, Suwon-si (KR); and Sanghyuck Ha, Yongin-si (KR)
Assigned to Samsung Electronics Co., Ltd., Gyeonggi-do (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed on Sep. 8, 2020, as Appl. No. 17/014,158.
Claims priority of application No. 10-2019-0117485 (KR), filed on Sep. 24, 2019; and application No. 10-2020-0029807 (KR), filed on Mar. 10, 2020.
Prior Publication US 2021/0089898 A1, Mar. 25, 2021
Int. Cl. G06N 3/08 (2023.01); G06N 3/04 (2023.01)
CPC G06N 3/08 (2013.01) [G06N 3/04 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computing system comprising:
a neural network system configured to drive an artificial neural network (ANN); and
a quantization system configured to quantize the ANN,
wherein the quantization system is configured to
quantize parameters of the ANN to generate quantized parameters of the ANN,
generate a quantization error of the parameters of the ANN based on the parameters of the ANN and the quantized parameters,
generate a compensation bias based on the quantized parameters and the quantization error of the parameters of the ANN, and
transmit the quantized parameters and the compensation bias to the neural network system,
wherein the parameters of the ANN comprise a weight and a bias of the ANN and the quantized parameters include a quantized weight and a quantized bias,
wherein the compensation bias is based on a result of at least one of a second multiply-accumulate (MAC) operation or a result of a third MAC operation,
wherein the second MAC operation includes a reference sample and a quantization error of the weight as inputs and the third MAC operation includes a quantization error of the reference sample and the quantized weight as inputs, and
wherein the neural network system is configured to
receive a quantized input sample,
receive the quantized parameters transmitted from the quantization system,
receive the generated compensation bias transmitted from the quantization system,
perform a first MAC operation based on the quantized input sample and the quantized parameters as inputs to the ANN, and
generate a final operation result by applying the compensation bias to a result of the first MAC operation.