US 11,928,575 B2
Activation function processing method, activation function processing circuit, and neural network system including the same
Yong Sang Park, Icheon (KR); and Joo Young Kim, Icheon (KR)
Assigned to SK hynix Inc., Icheon (KR)
Filed by SK hynix Inc., Icheon (KR)
Filed on Nov. 2, 2020, as Appl. No. 17/087,135.
Claims priority of application No. 10-2020-0048732 (KR), filed on Apr. 22, 2020.
Prior Publication US 2021/0334631 A1, Oct. 28, 2021
Int. Cl. G06N 3/04 (2023.01); G06F 12/02 (2006.01); G06N 3/048 (2023.01); G06N 3/063 (2023.01); G06N 5/025 (2023.01); H03K 19/17728 (2020.01)
CPC G06N 3/048 (2023.01) [G06F 12/0292 (2013.01); G06N 3/063 (2013.01); G06N 5/025 (2013.01); H03K 19/17728 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer implemented method using one or more hardware processors and a memory for activation function processing, the method comprising:
processing a first activation function in a first mode by referring to a shared lookup table that includes a plurality of function values of the first activation function,
wherein the shared lookup table includes at least a plurality of function values of a Sigmoid function or of a Hyperbolic tangent function; and
processing a second activation function in a second mode based on the plurality of function values of the first activation function in the shared lookup table, the second activation function being a different function than the first activation function,
wherein the processing of the first activation function and the second activation function is implemented using the one or more hardware processors and the memory.