US 12,175,083 B2
Native pipeline element abstract support in storage system
Philippe Armangau, Kalispell, MT (US); Vasu Subramanian, Chapel Hill, NC (US); Alan L. Taylor, Cary, NC (US); and Amihay Azruel, Raanana (IL)
Assigned to Dell Products L.P., Round Rock, TX (US)
Filed by Dell Products L.P., Round Rock, TX (US)
Filed on Nov. 29, 2022, as Appl. No. 18/070,674.
Prior Publication US 2024/0176492 A1, May 30, 2024
Int. Cl. G06F 3/06 (2006.01)
CPC G06F 3/0613 (2013.01) [G06F 3/0659 (2013.01); G06F 3/0673 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
providing a data object processing pipeline application for execution by processing circuitry included in a storage system, the data object processing pipeline application having a series of pipeline components including a first pipeline component and a second pipeline component;
executing, by the processing circuitry, the first pipeline component of the data object processing pipeline application, including:
ingesting a plurality of data objects from a computer or computerized device communicably coupled to the storage system;
successively writing the plurality of data objects to a first storage queue hosted on at least one storage object stored on at least one storage drive of the storage system; and
processing the plurality of data objects by calling a first plurality of functions from a function library included in the storage system, the calling of the first plurality of functions causing the plurality of data objects to be read from the first storage queue, causing a first processing operation to be performed on the plurality of data objects, and causing the plurality of data objects processed by the first processing operation to be successively written to a second storage queue hosted on the at least one storage object stored on the at least one storage drive of the storage system;
executing, by the processing circuitry, the second pipeline component of the data object processing pipeline application, including:
further processing the plurality of data objects by calling a second plurality of functions from the function library included in the storage system, the calling of the second plurality of functions causing the plurality of data objects processed by the first processing operation to be read from the second storage queue, and causing a second processing operation to be performed on the plurality of data objects processed by the first processing operation; and
providing the plurality of data objects processed by at least the first processing operation and the second processing operation from the storage system to the same computer or computerized device or other computer or computerized device communicably coupled to the storage system for subsequent use or analysis.