receiving, by a thread scheduler of the graph streaming processor, a group of threads, wherein the group of threads comprises a plurality of threads which operate on an input tensor, wherein each of the plurality of threads operates on inputs of the input tensor and a subset of a weight tensor to generate a subset of an output tensor;

calculating by the thread scheduler, a resource requirement for execution of the group of threads;

calculating, by the thread scheduler, resource availability in a plurality of processors of each of a plurality of processor arrays;

dispatching the group of threads to a selected one of the plurality of processors of the plurality of processor arrays that has a resource availability that meets or exceeds the resource requirement for execution of the group of threads; and

scheduling a group load instruction for all threads of the group of threads, comprising:

loading into a group load register a subset of inputs of the input tensor for processing of each thread of the group of threads, wherein the group load register provides the subset of the inputs of the input tensor to the group of threads of the selected one of the plurality of processors;

wherein all threads of the group of threads are synchronized when executing the group load instruction;

wherein all threads of the group of threads are processed independently on the selected one of the plurality of processors when not executing the group load instruction;

wherein the processing of each thread of the group of threads comprises generating a subset of outputs of the output tensor for each thread of the plurality of threads based on the subset of weights of the weight tensor and the inputs of the input tensor.