CPC G06F 11/1453 (2013.01) [G06F 11/1469 (2013.01); G06F 16/215 (2019.01); G06F 2201/84 (2013.01)] | 12 Claims |
1. A method, comprising:
identifying objects that each include one or more segments to be transferred from a source storage tier to a target storage tier, wherein the source storage tier comprises an active bucket for storing the one or more segments, the source storage tier further comprises a cold bucket, and the target storage tier comprises an active tier and a cold tier, which provides slower access to objects stored in the cold tier than the active tier provides to objects stored in the active tier;
determining, based on the objects identified, an amount of data to be transferred;
using a tiering controller to create worker nodes operable to transfer the segments to the target storage tier;
partitioning the objects across the workers, wherein the objects are partitioned across the workers to avoid repeated readout of the objects from storage;
transferring, from the source storage tier to the target storage tier, only those segments of the objects not already present in the target storage tier as a compression region in the target storage tier, and the transferring of the segments is performed by the worker nodes; and
placing metadata associated with objects, which are stored in the cold tier, in the cold bucket of the source storage tier.
|