| CPC G06F 11/3604 (2013.01) [G06F 8/656 (2018.02); G06F 8/77 (2013.01)] | 20 Claims |
|
1. A method of managing a data pipeline, the method comprising:
identifying availability of a new parameter to the data pipeline;
identifying a production pipe of the data pipeline based on the new parameter;
obtaining a shadow pipe for the data pipeline based at least in part on the new parameter, and the production pipe;
in an instance of the obtaining of the shadow pipe where the new parameter is not stable, instantiating a value supplementer adapted to supplement the new parameter during periods of time where values for the new parameter are unavailable;
obtaining an evaluation of the shadow pipe;
making a determination regarding whether the evaluation meets an evaluation criteria;
in a first instance of the determination where the evaluation meets the evaluation criteria:
updating operation of the data pipeline using the shadow pipe to obtain an updated data pipeline, and
providing computer implemented services using the updated data pipeline; and
in a second instance of the determination where the evaluation does not meet the evaluation criteria:
terminating the shadow pipe to retain the data pipeline, and
providing the computer implemented services using the data pipeline.
|