US 12,265,504 B2
Method and system of storing data to data storage for variable size deduplication
Assaf Natanzon, Hod Hasharon (IL)
Assigned to Huawei Technologies Co., Ltd., Shenzhen (CN)
Filed by HUAWEI TECHNOLOGIES CO., LTD., Shenzhen (CN)
Filed on Jun. 21, 2023, as Appl. No. 18/339,081.
Application 18/339,081 is a continuation of application No. PCT/EP2020/087373, filed on Dec. 21, 2020.
Prior Publication US 2023/0334023 A1, Oct. 19, 2023
Int. Cl. G06F 16/00 (2019.01); G06F 16/17 (2019.01); G06F 16/174 (2019.01)
CPC G06F 16/1752 (2019.01) [G06F 16/1734 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method of storing data to a data storage, wherein the data storage is divided into two or more variable size chunks, each of the variable size chunks is divided into blocks, and the data storage comprises a set of metadata for the data storage including information indicating a size of each variable size chunk,
wherein the data storage is also divided into two fixed size chunks, each fixed size chunk has a fixed size x and includes padding, the padding is positioned within the fixed size chunk and/or after the fixed size chunk to increase data amount in the chunk,
wherein division into fixed size chunks is independent of division into variable size chunks,
wherein the metadata includes a change indicator for each fixed size chunk indicating whether data has been written to the fixed size chunk,
wherein for one or more incoming write input output (IO) operations, the method comprises the following processes (a) and (b), each of which is written to a corresponding fixed size chunk:
(a) writing an incoming write IO to a position of the corresponding size chunk in the data storage, based on current parsing of the corresponding fixed size chunk;
(b) setting the change indicator for the corresponding fixed size chunk to indicate that the corresponding fixed size chunk has been changed since it was divided into variable sized chunks; and
based on one or more of the change indicators indicating that the division of an associated fixed size chunk or chunks into variable sized chunks should be changed, the method further comprises:
rechunking the fixed size chunk into variable sized chunks and setting the change indicator for that fixed size chunk to indicate that no write IO has been written to the fixed size chunk since it was divided into variable size chunks, and
setting the change indicator for that fixed size chunk to indicate that the fixed size chunk has not changed.