US 12,353,911 B2
Method, electronic device, and computer program product for scheduling computing resources
Jinpeng Liu, Shanghai (CN); Jiacheng Ni, Shanghai (CN); Zijia Wang, WeiFang (CN); and Zhen Jia, Shanghai (CN)
Assigned to Dell Products L.P., Round Rock, TX (US)
Filed by Dell Products L.P., Round Rock, TX (US)
Filed on Apr. 7, 2022, as Appl. No. 17/715,173.
Claims priority of application No. 202210255841.1 (CN), filed on Mar. 15, 2022.
Prior Publication US 2023/0297420 A1, Sep. 21, 2023
Int. Cl. G06F 9/48 (2006.01); G06N 3/084 (2023.01)
CPC G06F 9/4881 (2013.01) [G06N 3/084 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method, comprising:
acquiring a computing graph for a neural network, the computing graph comprising at least a plurality of nodes, each of the nodes comprising at least an operator for forward propagation of the neural network and a gradient operator of the operator for back propagation of the neural network; and
scheduling computing resources for the neural network based on the computing graph;
wherein the plurality of nodes comprise at least a plurality of upper nodes and a plurality of lower nodes, outputs from operators in a plurality of first upper nodes of the plurality of upper nodes are respective inputs to an operator in a first lower node of the plurality of lower nodes, and
scheduling the computing resources based on the computing graph comprises:
computing, in the forward propagation of the neural network, the operators in the plurality of first upper nodes in parallel using different computing resources, respectively; and
computing the operator in the first lower node upon completion of the computation of the operators in the plurality of first upper nodes.