US 12,079,161 B2
Data index for deduplication storage system
Richard Phillip Mayo, Bristol (GB); Peter Thomas Camble, Bristol (GB); and David Malcolm Falkinder, Bristol (GB)
Assigned to Hewlett Packard Enterprise Development LP, Spring, TX (US)
Filed by HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP, Houston, TX (US)
Filed on Jan. 25, 2022, as Appl. No. 17/583,617.
Prior Publication US 2023/0259488 A1, Aug. 17, 2023
Int. Cl. G06F 7/00 (2006.01); G06F 16/11 (2019.01); G06F 16/13 (2019.01); G06F 16/16 (2019.01)
CPC G06F 16/125 (2019.01) [G06F 16/137 (2019.01); G06F 16/162 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A storage system comprising:
a processor;
a memory; and
a machine-readable storage storing instructions, the instructions executable by the processor to:
receive a data stream to be stored in persistent storage of a deduplication storage system;
store data units of the data stream in a container entity group object according to arrival time, wherein the container entity group object is one of a plurality of container entity group objects;
record, in a plurality of container indexes, metadata for the data units stored in the container entity group object;
record, in a data index associated with the container entity group object, a list of the plurality of container indexes that record the metadata for the data units stored in the container entity group object, wherein the data index is one of a plurality of data indexes, wherein each data index of the plurality of data indexes is associated with a different container entity group object of the plurality of container entity group objects, and wherein each data index of the plurality of data indexes is to list only container indexes that reference data units stored in the container entity group object associated with that data index; and
in response to a determination that the total size of the container entity group object exceeds a first threshold size, transfer the container entity group object from memory to the persistent storage.