US 12,468,578 B2
Infrastructure managed workload distribution
Francesc Guim Bernat, Barcelona (ES); Karthik Kumar, Chandler, AZ (US); Alexander Bachmutsky, Sunnyvale, CA (US); Marcos E. Carranza, Portland, OR (US); and Rita H. Wouhaybi, Portland, OR (US)
Assigned to Intel Corporation, Santa Clara, CA (US)
Filed by Intel Corporation, Santa Clara, CA (US)
Filed on Dec. 22, 2021, as Appl. No. 17/559,833.
Prior Publication US 2022/0114032 A1, Apr. 14, 2022
Int. Cl. G06F 9/50 (2006.01); G06F 9/48 (2006.01)
CPC G06F 9/5083 (2013.01) [G06F 9/4881 (2013.01)] 24 Claims
OG exemplary drawing
 
1. An infrastructure processing unit (IPU) comprising:
a network connector;
a Compute Express Link (CXL) connector; and
processing circuitry configured to:
receive a workload via the network connector or the CXL connector, the workload including a workload definition including a plurality of pipelined stages of the workload and a respective performance expectation for each of the plurality of pipelined stages;
provide, via the CXL connector, the workload to a processor of a compute node for execution;
access execution stacks from pooled memory of the compute node, wherein the execution stacks indicate that a stage of the workload is performing below its respective performance expectation based on the workload execution; and
modify the execution of the stage of the workload in response to the indication that the stage of the workload is performing below its respective performance expectation, wherein the modifying results in performance of the workload meeting a predetermined service level agreement by intercepting, during the execution and via the CXL connector, a resource request of the stage of the workload to the compute node and redirecting the resource request to additional hardware utilized by the stage of the workload during the execution.