US 12,235,805 B1
Data replication using reinforcement learning to dynamically initiate transfer of replication data
Si Zhang, Chengdu (CN); Jeff Jianfei Yang, Chengdu (CN); David Jinfeng Dai, Chengdu (CN); Pan Xiao, Chengdu (CN); and Hua Peng, Chengdu (CN)
Assigned to Dell Products L.P., Round Rock, TX (US)
Filed by Dell Products L.P., Round Rock, TX (US)
Filed on Nov. 3, 2023, as Appl. No. 18/501,197.
Claims priority of application No. 202311387804.7 (CN), filed on Oct. 23, 2023.
Int. Cl. G06F 16/10 (2019.01); G06F 16/178 (2019.01); G06N 20/00 (2019.01)
CPC G06F 16/178 (2019.01) [G06N 20/00 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
obtaining a state of an information technology infrastructure for transferring replication data from a first storage system to a second storage system, wherein the state comprises an amount of replication data to be transferred to the second storage system;
assigning a reward value to one or more previously completed replication sessions based at least in part on whether a respective previously completed replication session satisfies a designated data recovery objective;
determining a start time, using a reinforcement learning framework, for transferring the replication data to the second storage system, wherein the determining is based at least in part on one or more of the assigned reward values; and
initiating the transfer of the replication data from the first storage system to the second storage system using the determined start time;
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.