CPC G06F 16/283 (2019.01) [G06F 16/2264 (2019.01); G06F 16/24532 (2019.01); G06F 16/278 (2019.01)] | 17 Claims |
1. A computer-implemented method for managing time series data performed by a data management service system, the method comprising:
receiving a first time series data record included in a time series data stream, the first time series data record being associated with a first data topic and comprising a first timestamp;
assigning a first sequence number to the first time series data record;
determining, by a streaming writer service, based on information accessed from a definitions metastore and the first data topic, that the first time series data record is associated with a data topic indicated for storage in a hot data store;
writing, by the streaming writer service, the first time series data record to a first data partition included in the hot data store;
writing, by a canonical store writer service, the first time series data record to a canonical data store; and
writing, by a segment extraction service, the first time series data record from the canonical data store to a first data partition included in a cold data store based on the information accessed from the definitions metastore, the first data partition included in the cold data store being associated with a first time bucket, the first timestamp being associated with the first time bucket.
|