US 12,487,766 B1
Durable asynchronous replication in a distributed storage system
Arkady Michael Degtiarov, Newton, MA (US); Hyong Hark Lee, Boston, MA (US); Daivat Bhatt, Cambridge County, MA (US); Neil Patel, Cambridge, MA (US); Jaykumar Patel, Cambridge, MA (US); Hasti Gheibi Dehnashi, Dorchester, MA (US); Yuchen Guo, Waltham, MA (US); Pari Jean Fariborz Garay, Belmont, MA (US); Osvaldo Vallejo Zamora, Fowler, CA (US); and Anas Daboussi, Watertown, MA (US)
Assigned to Amazon Technologies, Inc., Seattle, WA (US)
Filed by Amazon Technologies, Inc., Seattle, WA (US)
Filed on Jun. 29, 2023, as Appl. No. 18/344,365.
Int. Cl. G06F 3/06 (2006.01)
CPC G06F 3/065 (2013.01) [G06F 3/0619 (2013.01); G06F 3/067 (2013.01)] 20 Claims
OG exemplary drawing
 
5. A computer-implemented method comprising:
under control of a storage system comprising one or more computing devices configured to execute specific instructions:
generating a sequence identifier for a replication marker based on a monotonically-changing sequence identifier generation algorithm;
committing a transaction comprising saving a data object to a persistent object storage location and saving the replication marker to a first persistent storage directory for pending replication tasks, wherein the replication marker comprises the sequence identifier, an identifier of a replication task for replicating the data object to a remote storage system, and a link to the data object at the persistent object storage location, and wherein the first persistent storage directory comprises a replication queue;
determining, based on a presence of the replication marker in the first persistent storage directory, to dequeue the replication marker from the replication queue;
moving the replication marker to a second persistent storage directory for in-process replication tasks;
attempting replication of the data object to the remote storage system; and
moving the replication marker to a third persistent storage directory based on a result of attempting replication of the data object to the remote storage system.