CPC G06F 16/215 (2019.01) [G06F 16/22 (2019.01); G06F 16/2365 (2019.01); G06F 16/289 (2019.01); H04L 67/01 (2022.05)] | 17 Claims |
1. A method comprising:
receiving, by an object management system, a plurality of objects to be stored;
identifying, within the plurality of objects, a subset of objects associated with both a same time period and a same namespace, the identifying comprising distinguishing the subset of objects from other objects within the plurality of objects that do not share the same time period and the same namespace;
generating a batch object comprising the subset of objects and excluding the other objects;
issuing a write request to store the batch object in an object storage system;
for each object in the subset of objects, storing, by the object management system, an entry in a data structure comprising an identifier of the batch object and a position of the object within the batch object;
upon receiving, by the object management system, a first read request for a first object in the subset of objects, accessing the data structure to determine whether the object is stored in the object storage system;
based on a determination that the object is stored in the object storage system, issuing a second read request to the object storage system based on the identifier of the batch object and the position of the first object within the batch object;
detecting that all objects of the subset of objects in the batch object are expired based on an expiration time associated with each object; and
responsive to detecting that all of the subset of objects in the batch object are expired:
sending to the object storage system a request to delete the batch object from the object storage system; and
deleting the respective entries from the data structure associated with each of the subset of objects.
|