US 12,222,913 B2
Efficient method to optimize distributed segment processing mechanism in dedupe systems by leveraging the locality principle
Kalyan C. Gunda, Bangalore (IN); and Jagannathdas Rath, Karnataka (IN)
Assigned to EMC IP Holding Company LLC, Hopkinton, MA (US)
Filed by EMC IP Holding Company LLC, Hopkinton, MA (US)
Filed on Nov. 30, 2023, as Appl. No. 18/525,344.
Application 18/525,344 is a continuation of application No. 17/191,403, filed on Mar. 3, 2021, granted, now 12,032,536.
Prior Publication US 2024/0111737 A1, Apr. 4, 2024
Int. Cl. G06F 16/215 (2019.01); G06F 16/23 (2019.01)
CPC G06F 16/215 (2019.01) [G06F 16/2379 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
sending, by a client to a dedupe system, a set of fingerprints for filtering by the dedupe system;
receiving, by the client from the dedupe system, fingerprints of the set of fingerprints that were identified by the dedupe system as unique fingerprints, and additional non-unique fingerprints from a set of containers of the dedupe system;
sending, by the client to the dedupe system, only unique segments for writing by the dedupe system, and the unique segments form a set;
receiving, by the client system, data from a backup dataset, and segmenting and fingerprinting the data from the backup dataset to create a next set of fingerprints;
filtering, by the client system, fingerprints in the next set of fingerprints, using additional existing fingerprints received earlier from the dedupe system, so as to identify unique segments of the next set; and
sending, by the client system to the dedupe system, a segment tree of the unique segments of the next set.