CPC G06F 16/254 (2019.01) [G06F 16/2457 (2019.01); G06N 7/01 (2023.01)] | 14 Claims |
1. A computer-implemented method for delivery of a data pipeline on a cloud platform, the method comprising:
receiving a cloud-platform independent specification for data pipeline units of the data pipeline
comprising: inputs, outputs, one or more storage units, and one or more data transformations for each of the data pipeline units, respectively;
identifying a target cloud platform from candidate cloud platforms for deployment and execution of the data pipeline; and
for each of the data pipeline units, on a unit by unit basis, generating instructions for configuring the data pipeline units on the target cloud platform from the cloud-platform independent specification, the instructions comprising:
a system configuration, and
a deployment package;
provisioning computing infrastructure of the target cloud platform for the data pipeline units according to the system configuration and the deployment package of the data pipeline units;
creating a connection with the computing infrastructure of the target cloud platform; and
after receiving input data for the data pipeline units via the connection, executing the generated instructions stored in the deployment package of the data pipeline units.
|