US 12,436,701 B2
System and method for hash-based data deduplication
Alexander Shknevsky, Fair Lawn, NJ (US); Uri Shabi, Tel Mond (IL); and Vamsi K. Vankamamidi, Hopkinton, MA (US)
Assigned to Dell Products L.P., Round Rock, TX (US)
Filed by Dell Products L.P., Round Rock, TX (US)
Filed on Jan. 27, 2023, as Appl. No. 18/160,548.
Prior Publication US 2024/0256165 A1, Aug. 1, 2024
Int. Cl. G06F 3/06 (2006.01)
CPC G06F 3/0641 (2013.01) [G06F 3/0608 (2013.01); G06F 3/067 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A computer-implemented method executed on a computing device comprising:
maintaining a pointer quantity count for each of a plurality of virtual mapping groups, wherein each virtual mapping group is associated with a duplicative data portion within a storage platform and each pointer quantity count defines the number of pointers included within the corresponding virtual mapping group;
determining that a specific pointer quantity count for a specific virtual mapping group is reduced to zero;
obtaining a hash value for the specific duplicative data portion associated with the specific virtual mapping group from a locally-stored hash repository using the specific virtual mapping group in response to the specific pointer quantity count for the specific virtual mapping group being reduced to zero, wherein the hash value is a hash representation of the specific duplicative data portion, wherein the locally-stored hash repository of hash values is defined from thinly-provisioned defragmentation space in the storage platform;
searching a deduplication index for the occurrence of the hash value for the specific duplicative data portion associated with the specific virtual mapping group to define one or more occurrences of the hash value within the deduplication index, wherein the deduplication index is a separate data structure from the locally-stored hash repository; and
removing the one or more occurrences of the hash value within the deduplication index.