| CPC G06F 9/4843 (2013.01) [G06F 9/52 (2013.01)] | 17 Claims |
|
1. A computer-implemented method, the method comprising:
receiving, as an input, configuration properties of a group of operators of a data pipeline, the data pipeline including a specified multiplicity greater than 1;
generating, as an output, a configuration for two new operators, including a first new operator that transforms a dataset output of a preceding operator according to the configuration properties of the group of operators of the data pipeline and dispatches the transformed dataset to the replicas of the group of operators of the data pipeline and a second new operator that collects results of the replicas of the group of operators of the data pipeline and computes, based on the configuration properties of the group of operators of the data pipeline and an order preserving requirement, a result dataset that it provides to a succeeding operator; and
automatically inserting the first new operator and the second new operator into a deployment of the data pipeline, the first new operator being inserted before a number of replicas of the group of operators of the data pipeline corresponding to the specified multiplicity and the second new operator being inserted after the number of replicas of the group of operators of the data pipeline corresponding to the specified multiplicity.
|