| CPC G06F 8/443 (2013.01) [G06F 8/451 (2013.01); G06N 3/044 (2023.01)] | 20 Claims |
|
1. A computer-implemented method performed by a system comprising one or more computers and configured to execute a compiler optimization network, the method comprising:
receiving an input program, wherein the input program defines a graph of operation modules, wherein each node in the graph is a respective operation module, and each edge between nodes in the graph represents one operation module receiving the output generated by another operation module;
providing a representation of the input program to the compiler optimization network comprising:
a graph-embedding network executable by the system that is configured to encode operation features and operation dependencies of the operation modules of the input program into a graph embedding representation, and
a policy network executable by the system that is configured to generate an optimization action for each of one or more nodes encoded in the graph embedding representation, wherein the policy network employs segmented recurrent attention layers to concurrently generate optimization actions for multiple different tasks, wherein each layer of the segmented recurrent attention layers is dedicated to generating a respective optimization action for a different task of the multiple different tasks;
obtaining, from the compiler optimization network, an output optimization plan comprising one or more optimization actions for each of the multiple different tasks of the input program; and
executing the input program using the output optimization plan.
|