CPC G06F 3/0617 (2013.01) [G06F 3/065 (2013.01); G06F 3/0644 (2013.01); G06F 3/0647 (2013.01); G06F 3/0653 (2013.01); G06F 3/0659 (2013.01); G06F 3/0673 (2013.01)] | 20 Claims |
1. A computer-implemented method, comprising:
obtaining an indication, via a programmatic interface, from a client of a data streaming service, of a retention period for records of a data stream, wherein:
the data stream comprises a sequence of the records being streamed from one or more data sources to one or more data consumers;
the one or more data sources perform write operations to the data stream to generate data portions to be included in respective contents of the records;
the respective contents of the respective records comprise respective sequence numbers indicative of an order in which the respective records were received into the data stream; and
the one or more data consumers perform read operations on the data stream to access the respective contents of the respective data records; and
storing the records of the data stream at a first set of storage devices of the data streaming service; and
in response to detecting that one or more of the records of the data stream have remained at the first set of storage devices for at least the retention period, transferring the one or more records to a second set of storage devices.
|