CPC G06F 16/13 (2019.01) [G06F 9/54 (2013.01); G06F 16/172 (2019.01)] | 20 Claims |
1. A non-transitory machine-readable medium having machine-executable instructions comprising an indexer that:
retrieves a set of messages generated by a given data source of a plurality of data sources from a data storage implemented as non-volatile memory;
processes the set of messages to generate processed data for the given data source and generate an index file identifying a location of a data file associated with the processed set of messages;
stores the processed data in a cache implemented as volatile memory, wherein the processed data includes the data file with data from the given data source;
updates the index file for the processed data to identify the cache as the location of the data file responsive to storing the process data in the cache;
determines when the processed data for the given generation source reaches a threshold size;
stores the data file of the processed data in the data storage implemented as the non-volatile memory responsive to determining that the processed data has reached the threshold size;
updates the index file for the processed data to identify the data storage as the location of the data file responsive to storing the data file in the data storage implemented as the non-volatile memory;
identifies exceptions within the processed data for the set of messages; and
performs an operation on the exceptions within the processed data in response to identifying the exceptions.
|