CPC G06F 16/2272 (2019.01) [G06F 3/065 (2013.01); G06F 3/0619 (2013.01); G06F 3/0685 (2013.01); G06F 16/2291 (2019.01); G06F 16/2452 (2019.01); G06F 16/24565 (2019.01)] | 18 Claims |
1. A method comprising:
periodically receiving, by a processor coupled to a non-transitory storage memory, new data from one or more servers, the non-transitory storage memory comprising a first set of memory locations storing sorted existing data, the sorted existing data being sorted according to an object type associated with the sorted existing data and further according to a timestamp of the sorted existing data;
storing, by the processor, the new data into a second set of memory locations by appending the new data sequentially to the first set of memory locations;
during a time window to make a data file available for retrieval, determining, by the processor, whether an offline periodic full sort of the data file is performed at a current time; and
in response to the determining that an offline periodic full sort of the data file is performed at the current time:
sorting, by the processor, the new data into sorted new data, the sorted new data being sorted according to the object type associated with the new data and further according to a timestamp of the new data; and
merging, by the processor, the sorted new data in the second set of memory locations and the sorted existing data in the first set of memory locations, thereby generating merged data sorted according to the object type associated with the merged data and further according to a timestamp of the merged data, wherein the merging includes purging a subset data of the merged data outside a history window.
|