| CPC G06F 16/24549 (2019.01) [G06F 16/22 (2019.01); G06F 16/2471 (2019.01); G06F 16/256 (2019.01)] | 17 Claims |

|
1. A computer-implemented method comprising:
receiving data from one or more data sources;
generating records based on the received data;
adding the records to a current record file;
adding index metadata to the records, the index metadata for a given record including a path and an offset, the path identifying a file in a datastore that includes the given record and the offset indicating a location of the given record in the file;
saving the current record file to the datastore;
loading the records in the current record file into a table in a cloud database
after adding the records to the current record file, determining whether one or more conditions are met; and
responsive to the one or more conditions being met:
starting a new record file,
saving the current record file to the datastore, and
loading the current record file into the table.
|