US 12,254,311 B2
Automatic extract, transform and load accelerator for data platform in distributed computing environment
Andrew Allen Holowaty, Dublin, OH (US); Pradeep Kumar Raghunath, Aurora, IL (US); and Arpan B Desai, Murphy, TX (US)
Assigned to INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US)
Filed by INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US)
Filed on Jan. 28, 2022, as Appl. No. 17/586,944.
Prior Publication US 2023/0244475 A1, Aug. 3, 2023
Int. Cl. G06F 8/71 (2018.01)
CPC G06F 8/71 (2013.01) 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for a software development accelerator tool comprising:
selecting operations from a multiplicity of preconfigured existing operations through a database engine layer of a distributed computing environment;
ordering the operations selected as part of a configuration;
determining whether dependencies are met for the operations selected before processing the configuration;
tracking the processing of the operations selected in the configuration by generating a batch identification (ID) through the database engine layer of the distributed computing environment; and
performing operations with a data pipeline in the order specified in the configuration, the data pipeline being applied to a plurality of different data sets from different sources.