US 11,656,917 B2
Distributed processing management apparatus, distributed processing method, and computer-readable recording medium
Masato Asahara, Tokyo (JP)
Assigned to NEC CORPORATION, Tokyo (JP)
Appl. No. 16/759,202
Filed by NEC CORPORATION, Tokyo (JP)
PCT Filed Oct. 25, 2018, PCT No. PCT/JP2018/039734
§ 371(c)(1), (2) Date Apr. 24, 2020,
PCT Pub. No. WO2019/082982, PCT Pub. Date May 2, 2019.
Claims priority of provisional application 62/577,408, filed on Oct. 26, 2017.
Prior Publication US 2020/0319936 A1, Oct. 8, 2020
Int. Cl. G06E 1/00 (2006.01); G06F 9/50 (2006.01); G06N 20/00 (2019.01); G06F 9/54 (2006.01)
CPC G06F 9/5083 (2013.01) [G06F 9/541 (2013.01); G06N 20/00 (2019.01)] 13 Claims
OG exemplary drawing
 
1. A distributed processing management apparatus connected to a plurality of execution servers configured to execute distributed processing so as to be able to communicate with the plurality of execution servers, the distributed processing management apparatus comprising:
one or more memories storing instructions; and
one or more processors configured to execute the instructions to function as:
a task reception unit configured to receive a task definition of distributed processing executed by the plurality of execution servers;
a data rearrangement instruction unit configured to, when each of the plurality of execution servers holds data to be used for the distributed processing in advance, based on the task definition received by the task reception unit, determine data to be held by each of the plurality of execution servers, and instruct each of the plurality of execution servers to perform data rearrangement so as to hold data according to the determination;
a pre-conversion instruction unit configured to issue, to each of the plurality of execution servers, and instruction to convert a data format of data held by the execution server to a predetermined common format; and
a conversion instruction unit configured to specify, for each of the plurality of execution servers, a data format usable by a machine learning engine executed by the execution server, and issue an instruction to convert a data format of data held by the execution server to the specified data format,
wherein the conversion instruction unit is configured to issue, to each of the plurality of execution servers, an instruction to convert the data format of data that has been converted to the common format to specified data format, and
wherein the pre-conversion instruction unit causes each of the plurality of execution servers to convert the data format of data after rearrangement to the common format.