US 11,941,019 B2
Accelerated automatic creation of data transformations
Andrew Ash, North Lawrence, OH (US)
Assigned to Treasure Data, Inc., Mountain View, CA (US)
Filed by Treasure Data, Inc., Mountain View, CA (US)
Filed on May 31, 2022, as Appl. No. 17/828,892.
Prior Publication US 2023/0385300 A1, Nov. 30, 2023
Int. Cl. G06F 16/25 (2019.01); G06F 16/21 (2019.01)
CPC G06F 16/258 (2019.01) [G06F 16/21 (2019.01); G06F 16/254 (2019.01)] 24 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
receiving, from a user computer at a server computer, a configuration file specifying one or more data source identifiers of source database tables in a target database system, one or more data sink identifiers of sink database tables in the target database system, and two or more data transformations;
the server computer initiating execution of a data transformation framework by loading one or more configuration parameters of the configuration file into main memory of the server computer to define a workflow;
creating and storing a configuration table based on the configuration file, the configuration table comprising a plurality of dynamic queries, a plurality of identifiers of transformation functions, and names of the two or more data transformations;
in the configuration table, for each of the two or more data transformations, creating plurality of dynamic common table expression queries, each of the dynamic common table expression queries being associated with a particular transformation function matching one of the plurality of identifiers of the transformation functions;
based on the configuration table, serially executing the dynamic common table expression queries to serially execute the two or more data transformations of the source database tables to the sink database tables.