CPC G06F 13/20 (2013.01) [G06F 15/7867 (2013.01)] | 15 Claims |
1. A data processing system, comprising:
memory storing a dataflow graph for an application, the dataflow graph having a plurality of compute nodes, wherein compute nodes in the plurality of compute nodes are configured to be producers to produce data for execution of the application, and to be consumers to consume the data for execution of the application;
compile time logic configured to partition execution of the dataflow graph into stages, wherein each of the stages has one or more compute nodes, one or more producers, and one or more consumers;
runtime logic configured with the compile time logic to determine a processing latency for each of the stages by calculating time elapsed between producers of a particular stage receiving input data and consumers of the particular stage receiving output data, wherein the output data is generated by compute nodes of the particular stage based on processing the input data; and
instrumentation profiling logic configured to generate performance statistics for the dataflow graph based on the processing latency determined for each of the stages.
|