US 11,893,257 B2
Multipart uploading to object-based storage
Peng Hui Jiang, Beijing (CN); FengLi Wang, Beijing (CN); Qi Feng Huo, Beijing (CN); Jun Su, Beijing (CN); Hong Qing Zhou, Shanghai (CN); Yan Lin Ren, Shanghai (CN); Li Zhang, Beijing (CN); and Ling Ling Sh Hu, Shanghai (CN)
Assigned to International Business Machines Corporation, Armonk, NY (US)
Filed by International Business Machines Corporation, Armonk, NY (US)
Filed on Jun. 15, 2022, as Appl. No. 17/840,762.
Prior Publication US 2023/0409224 A1, Dec. 21, 2023
Int. Cl. G06F 3/06 (2006.01)
CPC G06F 3/0646 (2013.01) [G06F 3/0604 (2013.01); G06F 3/064 (2013.01); G06F 3/0673 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system, said system comprising:
a memory;
a processor in communication with said memory, said processor configured to perform operations, said operations comprising:
obtaining a plurality of transaction logs in blocks from a plurality of nodes of a data storage system, wherein said plurality of transaction logs include a first transaction log and a second transaction log;
for each of said plurality of transaction logs:
splitting said transaction log into log entries;
grouping said log entries into groups, said log entries in each of said groups being associated with a same data source; and
writing said log entries of said groups to empty blocks, wherein log entries from different groups do not share a same block;
identifying a same sequence of log entries from a written first transaction log and a written second transaction log; and
uploading one or more first blocks of said first transaction log that include said same sequence of log entries to an object-based storage, without uploading one or more second blocks of said second transaction log that include said same sequence of log entries to said object-based storage.