US 12,130,800 B2
Content processing data ingestion pipeline monitoring and management system
Charlie Corredor, Seattle, WA (US); Mengdong Yang, Sammamish, WA (US); Christoffer Benjamin Rosen, Seattle, WA (US); Varadarajan Subramaniam Thiruvillamalai, Bellevue, WA (US); Shijie Ma, Bellevue, WA (US); Thottam R. Sriram, Redmond, WA (US); Sarosh Anwar, Redmond, WA (US); Shashi Rekha Singaravel, Sammamish, WA (US); and Robin M. Thomas, Sammamish, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Dec. 27, 2022, as Appl. No. 18/089,316.
Prior Publication US 2024/0211463 A1, Jun. 27, 2024
Int. Cl. G06F 16/23 (2019.01); G06F 16/215 (2019.01)
CPC G06F 16/2365 (2019.01) [G06F 16/215 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
ingesting, through a data ingestion pipeline, a plurality of content elements from a source to a destination, the ingestion pipeline comprising a plurality of nodes between the source and the destination;
detecting, by a data management system, a gap in the ingestion pipeline, the gap indicating a difference associated with a content element of the plurality of content elements between a first node and a second node of the ingestion pipeline;
in response to detecting the gap, determining whether the content element is found at the second node;
based on the content element being found at the second node, determining whether an issue is a system-based issue or a single issue; and
automatically triggering, by the data management system, reingesting of the content element from the first node based on the issue being the single issue or in response to a repair performed on a component or machine associated with the ingestion pipeline based on the system-based issue.