US 10,891,261 B2
Method and device for deduplication
Leon Zhang, Beijing (CN); Henry Hao Fang, Beijing (CN); Chen Gong, Beijing (CN); Lester Ming Zhang, Beijing (CN); Yongli Wang, Beijing (CN); and Huan Chen, Beijing (CN)
Assigned to EMC IP Holding Company LLC, Hopkinton, MA (US)
Filed by EMC IP Holding Company LLC, Hopkinton, MA (US)
Filed on May 30, 2018, as Appl. No. 15/992,483.
Claims priority of application No. 2017 1 0408364 (CN), filed on Jun. 2, 2017.
Prior Publication US 2019/0034449 A1, Jan. 31, 2019
Int. Cl. G06F 16/174 (2019.01); G06F 13/16 (2006.01)
CPC G06F 16/1748 (2019.01) [G06F 13/1668 (2013.01); G06F 16/1744 (2019.01)] 12 Claims
OG exemplary drawing
 
1. A method of deduplication, comprising:
obtaining a property of a file stream, the property of the file stream including a file type or a magic number identifying a format of a protocol or a file;
in response to receiving an I/O request for a data block of the file stream, assigning a deduplication level to the I/O request based on the property of the file stream at least in part by determining whether the file stream is compressed based on the property of the file stream and assigning the deduplication level based on whether the file stream is compressed, wherein assigning the deduplication level based on the determining comprises:
in response to determining that the file stream is compressed, assigning a first deduplication level to the I/O request,
in response to failing to determine whether the file stream is compressed, assigning a second deduplication level to the I/O request, and
in response to determining that the file stream is uncompressed, assigning a third deduplication level to the I/O request; and
deduplicating the data block of the file stream based on the deduplication level assigned to the I/O request at least in part by, in response to the deduplication level assigned to the I/O request being the second deduplication level, skipping deduplication of the data block of the file stream regardless of a state of an available computing resource.