CPC G06F 16/285 (2019.01) [G06F 16/22 (2019.01)] | 20 Claims |
1. A computer-implemented method comprising:
receiving a stream of log data, the stream of log data comprising one or more groups of log data, each particular group of log data of the one or more groups of log data comprising one or more log messages sharing a common property associated with the particular group of log data;
extracting, from the stream of log data, the one or more groups of log data;
generating, using the one or more groups of log data, one or more log sets of data;
associating the one or more log sets of data with a log index, which is associated with a dedicated partition of computer memory of a memory device, the dedicated partition of computer memory corresponding to the common property;
assigning the log index to a log processing bucket, the log processing bucket comprising one or more log indexes, the log index included in the one or more log indexes, the log processing bucket comprising a data domain comprising the one or more log sets of data; and
assigning the log processing bucket to a log processor instance comprising one or more processing resources for processing log data, the one or more processing resources configured to:
access the data domain through one or more processing paths to retrieve a log set of data stored in the data domain;
input the log set of data to a data processing component to receive process data as output; and
store the processed data in the computer memory.
|