US 12,306,884 B2
Informed labeling of records for faster discovery of business critical information
Alex Robbins, Cambridge, MA (US); Akshaya Khare, Medford, MA (US); and Nicole Reineke, Northborough, MA (US)
Assigned to EMC IP Holding Company LLC, Hopkinton, MA (US)
Filed by EMC IP Holding Company LLC, Hopkinton, MA (US)
Filed on Jun. 29, 2021, as Appl. No. 17/362,702.
Prior Publication US 2022/0414165 A1, Dec. 29, 2022
Int. Cl. G06F 16/951 (2019.01); G06F 16/908 (2019.01); G06Q 30/0201 (2023.01)
CPC G06F 16/951 (2019.01) [G06F 16/908 (2019.01); G06Q 30/0201 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method, comprising:
crawling, by a data crawler, data included in a dataset;
based on the crawling of the data, creating and/or obtaining, by the data crawler, metadata concerning the data, the metadata including new metadata created by the data crawler, as well as previously obtained metadata that is associated with the data and that was obtained by a prior crawling of the data;
creating or modifying, by the data crawler, a data lineage record for the data by linking the previously obtained metadata with the new metadata;
crawling, by a meta crawler, the metadata and obtaining information about a data change event involving the data, wherein the meta crawler is operable to examine two or more directly linked pieces of metadata parsed from a common record and, based on this, calculate or otherwise determine any one or more of: how much data has been added to, or removed from, the record; whether the nature of the content within the record has changed, and the type of the change that has occurred; and, if sensitive data has been added to, or removed from, the record;
based on the crawling of the metadata, creating, by the meta crawler, a meta label that documents occurrence of the data change event, wherein the meta label indicates a state of the data at a time the data was crawled; and
associating the meta label with the metadata.