US 12,412,078 B1
Neural processing unit operable in multiple modes to approximate activation function
Jin Ung Jeong, Seoul (KR); Lok Won Kim, Yongin-si (KR); and Hyung Jin Chun, Suwon-si (KR)
Assigned to DEEPX CO., LTD., Seongnam-si (KR)
Filed by DEEPX CO., LTD., Seongnam-si (KR)
Filed on Jan. 31, 2025, as Appl. No. 19/042,006.
Claims priority of application No. 10-2024-0170131 (KR), filed on Nov. 25, 2024.
Int. Cl. G06N 3/048 (2023.01)
CPC G06N 3/048 (2023.01) 18 Claims
OG exemplary drawing
 
1. A neural processing unit comprising:
a controller circuit configured to select a first mode or a second mode for approximating application of a target activation function in a neural network model based on an analysis of the activation function;
one or more processors configured to execute a programmed activation function (PAF) and generate a first activation value in both the first mode and the second mode by applying the PAF, the first activation value used as an approximation of applying the target activation function in the first mode; and
a converter circuit coupled to the one or more processors and configured to convert the first activation value into a second activation value in the second mode but not in the first mode, the second activation value used in the second mode to approximate application of the target activation function more accurately than the first activation value.