US 12,367,022 B2
Method and system to determine execution inefficiencies in dataflow programs
Blaine Rister, San Francisco, CA (US); Qingjian Li, Berkeley, CA (US); Bowen Yang, Palo Alto, CA (US); Junjue Wang, Newark, CA (US); Chen Liu, Palo Alto, CA (US); Zhuo Chen, Palo Alto, CA (US); Arvind Sujeeth, Palo Alto, CA (US); and Sumti Jairath, Palo Alto, CA (US)
Assigned to SambaNova Systems, Inc., Palo Alto, CA (US)
Filed by SambaNova Systems, Inc., Palo Alto, CA (US)
Filed on Nov. 8, 2023, as Appl. No. 18/387,906.
Application 18/387,906 is a continuation of application No. 18/129,718, filed on Mar. 31, 2023.
Claims priority of provisional application 63/331,696, filed on Apr. 15, 2022.
Claims priority of provisional application 63/331,116, filed on Apr. 14, 2022.
Claims priority of provisional application 63/330,740, filed on Apr. 13, 2022.
Claims priority of provisional application 63/330,730, filed on Apr. 13, 2022.
Claims priority of provisional application 63/327,313, filed on Apr. 4, 2022.
Claims priority of provisional application 63/326,762, filed on Apr. 1, 2022.
Claims priority of provisional application 63/326,206, filed on Mar. 31, 2022.
Prior Publication US 2024/0069880 A1, Feb. 29, 2024
Int. Cl. G06F 9/44 (2018.01); G06F 8/41 (2018.01)
CPC G06F 8/433 (2013.01) 20 Claims
OG exemplary drawing
 
1. A method, the method comprising:
selecting, by a computer-implemented efficiency analyzer, from an intermediate representation of a dataflow program, a set of operators of the dataflow program, the set of operators included in a first mapping of the set of operators to first hardware to execute the set of operators, the first mapping included in the intermediate representation, the first hardware included in a first computing system for executing the dataflow program;
computing, by the efficiency analyzer, based on a hardware description and the first mapping, a first predicted execution metric associated with executing the set of operators on the first hardware, the hardware description corresponding to hardware included in the first computing system;
determining, by the efficiency analyzer, based on the first predicted execution metric, a first inefficiency metric associated with the executing the set of operators on the first hardware;
determining, by the efficiency analyzer, based on the hardware description and the first inefficiency metric, a first inefficiency associated with the dataflow program; and,
outputting, by the efficiency analyzer, first inefficiency results comprising the first inefficiency.