| CPC G06F 9/328 (2013.01) [G06F 9/30036 (2013.01); G06F 11/3006 (2013.01); G06F 16/164 (2019.01); G06N 20/20 (2019.01); G06F 9/5044 (2013.01); G06F 9/5066 (2013.01); G06F 9/5072 (2013.01); G06N 3/044 (2023.01); G06N 3/045 (2023.01); G06N 3/08 (2013.01)] | 20 Claims |

|
1. A method in a server, comprising:
receiving a dataflow plan comprising representations of data operations in a dataflow pipeline;
determining, based on the received dataflow plan, metadata of the received dataflow plan;
determining, based on the received dataflow plan, a feature set comprising a plurality of features;
selecting a machine learning (ML) model from a plurality of ML models based on the metadata of the received dataflow plan and metadata of a training set the selected ML model was trained on;
providing the feature set to the selected ML model;
receiving, from the selected ML model, the weighted dataflow plan associating a weight associated with a data operation of the data operations; and
causing execution of the received dataflow plan by resources allocated based on the weight.
|