US 12,346,350 B2
Meta-data driven ingestion and data processing
Marshall A. Isman, Newton, MA (US); Adam Weiss, Lexington, MA (US); Jonah Egenolf, Winchester, MA (US); Robert Parks, Weston, MA (US); John MacLean, Bilgola Plateau (AU); Richard Mellon, Winchester, MA (US); Dusan Radivojevic, North Andover, MA (US); Paul Veiser, Heathmont (AU); and Mazin Woodrow Khader, Cambridge, MA (US)
Assigned to Ab Initio Technology LLC, Lexington, MA (US)
Filed by Ab Initio Technology LLC, Lexington, MA (US)
Filed on Oct. 27, 2023, as Appl. No. 18/496,543.
Claims priority of provisional application 63/495,618, filed on Apr. 12, 2023.
Prior Publication US 2024/0346051 A1, Oct. 17, 2024
Int. Cl. G06F 16/20 (2019.01); G06F 3/048 (2013.01); G06F 9/448 (2018.01); G06F 9/451 (2018.01); G06F 16/28 (2019.01); G06F 16/908 (2019.01)
CPC G06F 16/288 (2019.01) [G06F 3/048 (2013.01); G06F 9/4494 (2018.02); G06F 9/451 (2018.02); G06F 16/908 (2019.01)] 23 Claims
OG exemplary drawing
 
1. A method implemented by a data processing system for processing data in conformance with specified criteria by providing a graphical user interface for selecting data to be processed, determining metadata of selected data, and, based on the metadata, automatically processing the selected data in conformance with the specified criteria, including:
receiving, by a data processing system, a specification that specifies one or more criteria for data by specifying logical metadata and one or more operations to be performed on data associated with the logical metadata;
providing, by a data processing system, a user interface for indicating one or more datasets to be retrieved and processed;
receiving, from the user interface, a user indication of a given dataset;
responsive to at least the user indication, identifying technical metadata for the given dataset;
accessing, from a storage device, a metadata model that specifies relationships among logical metadata and technical metadata;
traversing, by a data processing system, the metadata model accessed from the storage device to identify a relationship among (i) an item of logical metadata in the metadata model corresponding to an item of the logical metadata specified in the specification, and (ii) an item of technical metadata in the metadata model corresponding to an item of the technical metadata for the given dataset;
based on the identified relationship, determining that at least one of the one or more operations are to be performed on data associated with the given dataset and with the item of technical metadata for the given dataset;
generating, by a data processing system, an executable computer program configured to:
perform the determined at least one of the one or more operations on the data associated with the given dataset and with the item of technical metadata for the given dataset such that the data is in accordance with the one or more criteria; and
after performing the determined at least one of the one or more operations, store, in a storage device, the data that is in accordance with the one or more criteria; and
executing, by a data processing system, the executable computer program to perform operations including:
performing, by a data processing system, the determined at least one of the one or more operations on the data associated with the given dataset and with the item of technical metadata for the given dataset such that the data is in accordance with the one or more criteria; and
after performing the determined at least one of the one or more operations, storing, in the storage device, the data that is in accordance with the one or more criteria.