| CPC G06F 9/505 (2013.01) [G06F 9/5072 (2013.01); G06F 9/547 (2013.01); G06F 16/13 (2019.01); G06F 16/164 (2019.01); G06F 16/182 (2019.01); G06F 16/192 (2019.01); G06F 16/254 (2019.01); G06F 16/81 (2019.01); G06F 2209/503 (2013.01)] | 20 Claims |

|
1. A method comprising:
receiving, by a control plane of a data analytics system, a request from a client device to execute a workflow included in a packaged workflow file stored in cloud storage communicably coupled to the data analytics system;
publishing, by the control plane of the data analytics system, a message to a message queue, the message requesting execution of the workflow and including metadata identifying the packaged workflow file;
consuming, by a data plane of the data analytics system, the message via the message queue;
responsive to consuming the message, creating, by the data plane of the data analytics system, an execution engine wrapper container within the data plane, the execution engine wrapper container comprising a virtualized instance of computational resources of the data analytics system and including an execution engine, wherein creating the execution engine wrapper container comprises defining resource parameters that limit use, by the execution engine wrapper container, of hardware resources of the data analytics system;
retrieving, by the execution engine wrapper container, the packaged workflow file from the cloud storage using the metadata;
generating, by the execution engine, results for the workflow by executing code of the packaged workflow file;
deleting, by the data plane of the data analytics system, the execution engine wrapper container in response to detecting that the execution engine generated the results; and
transmitting, by the control plane of the data analytics system, the results of executing the workflow to the client device.
|