US 12,190,166 B1
System and method for observing and predicting data batch activity in real time
Vishal Deshmukh, Plainsboro, NJ (US); Sujit Eapen, Plainsboro, NJ (US); Himanshu Rout, Bengaluru (IN); Rashad Barron, Stroudsburg, PA (US); Rachit Mehrotra, Princeton, NJ (US); Tanmay Nagar, Mumbai (IN); and Tejas Shah, Bengaluru (IN)
Assigned to Morgan Stanley Service Group Inc., New York, NY (US)
Filed by Morgan Stanley Services Group Inc., New York, NY (US)
Filed on Jun. 11, 2024, as Appl. No. 18/739,658.
Int. Cl. G06F 9/50 (2006.01)
CPC G06F 9/505 (2013.01) 9 Claims
OG exemplary drawing
 
1. A computer-implemented method for monitoring and predicting data batch activity in real time comprising:
obtaining i) ordered lists of jobs of a batch from one or more scheduling platforms including and ii) information related to file transfers from one or more file transfer sources, the ordered lists and information related to file transfers being updated in real time;
extracting data from the ordered and the information from the one or more file transfer sources;
enriching the extracted data using additional information retrieved from at least one meta data repository;
generating a dependency graph that includes real time job and file transfer data obtained from the enriched data in which nodes of the graph represent events and edges represent relationships between the nodes indicating a dependence, wherein if one event is dependent on the execution of a prior event, the event is considered dependent on the prior event;
obtaining critical milestones from the dependency graph;
generating critical paths for traversing the dependency graph for job and file transfer execution using the milestones; and
predicting in real time, times for execution of each of the jobs and file transfers in the critical paths.