US 12,277,500 B2
Neural network optimization method, electronic device and processor
Yudong Li, Fujian (CN); and Xiaolong Liu, Fujian (CN)
Assigned to SIGMASTAR TECHNOLOGY LTD., Fujian (CN)
Filed by Xiamen SigmaStar Technology Ltd., Fujian (CN)
Filed on May 19, 2021, as Appl. No. 17/324,536.
Claims priority of application No. 202010924255.2 (CN), filed on Sep. 4, 2020.
Prior Publication US 2022/0076123 A1, Mar. 10, 2022
Int. Cl. G06N 3/08 (2023.01); G06F 11/07 (2006.01); G06N 3/082 (2023.01)
CPC G06N 3/082 (2013.01) [G06F 11/0751 (2013.01); G06F 11/0793 (2013.01)] 11 Claims
OG exemplary drawing
 
1. A neural network optimization method for optimizing a neural network for operating on a device having a hardware constrained calculation platform performed by a processor, comprising:
selecting an operator to be replaced from a plurality of operators in a network layer according to a predetermined condition;
replacing the operator to be replaced by a plurality of equivalent operators according to a calculation function corresponding to the operator to be replaced, wherein the plurality of equivalent operators comprises a target operator;
pre-calculating for a first operator among the plurality of equivalent operators to complete a calculation function of the first operator, and inputting a calculation result into the target operator;
identifying a second operator according to data change conditions of the plurality of equivalent operators, and combining the second operator with the target operator; and
deleting the first operator,
wherein a first power needed by the processor to operate the neural network prior to applying the optimization method is greater than a second power needed by the processor to operate the neural network after applying the optimization method, and
wherein a first granularity of the neural network prior to applying the optimization method and a second granularity of the neural network after applying the optimization method are the same.