CPC G06F 8/4452 (2013.01) [G06F 21/577 (2013.01)] | 20 Claims |
1. A system for facilitating updates to data pipelines using modularly-generated platform-agnostic data pipeline portions, the system comprising:
at least one processor; and
at least one memory coupled to the at least one processor and storing instructions that, when executed by the at least one processor, perform operations comprising:
receiving, via a graphical user interface (GUI) within a web-browsing application, a user selection of a portion of a platform-agnostic data pipeline comprising: (i) a set of nodes each indicating a data pipeline component and (ii) a set of links each linking two or more nodes of the set of nodes;
generating via a transformation component and using the user selection, a platform-agnostic modular-portion of a data pipeline architecture;
storing the generated platform-agnostic modular-portion of the data pipeline architecture in a remote database configured to store platform-agnostic modular-portions of data pipeline architectures;
receiving an update to at least one node of the set of nodes indicating a first data pipeline component of the generated platform-agnostic modular-portion of the data pipeline architecture;
determining a set of pre-existing data pipeline architectures that use the generated platform-agnostic modular-portion of the data pipeline; and
in response to determining the set of pre-existing data pipeline architectures that use the generated platform-agnostic modular-portion of the data pipeline, updating at least a subset of the set of pre-existing data pipeline architectures to incorporate the update to the at least one node of the set of nodes indicating the first data pipeline component.
|