CPC G06F 16/254 (2019.01) | 20 Claims |
1. A system to reduce data loading time from one or more source systems, minimize any effect on the one or more source systems during data loading, and correct any error in the data, comprising:
a computer system comprising a processor and a memory, the computer system configured to:
invoke batch data loading of data of one or more source systems into an unconstrained area of an input staging area to reduce data loading time from the one or more source systems and minimize any effect on the one or more source systems during data loading;
automatically select one or more staging and master interfaces based on metadata of the one or more source systems;
automatically select relational table structures based on semantic mapping metadata;
evaluate the data loaded into the input staging area by an error correction workflow;
move any error records into an error table;
correct any error records in the error table by a spooler within the error correction workflow;
load the data from the input staging area and corrected data from the error table into a master repository; and
load the data from the master repository into an output staging area.
|