US 12,477,032 B2
Data processing method, execution workstation, distributed computing system, and storage medium
Bowen Yu, Beijing (CN); and Wenguang Chen, Beijing (CN)
Assigned to TSINGHUA UNIVERSITY, Beijing (CN)
Appl. No. 18/576,856
Filed by TSINGHUA UNIVERSITY, Beijing (CN)
PCT Filed Jul. 6, 2022, PCT No. PCT/CN2022/104127
§ 371(c)(1), (2) Date Jan. 5, 2024,
PCT Pub. No. WO2023/280207, PCT Pub. Date Jan. 12, 2023.
Claims priority of application No. 202110766780.0 (CN), filed on Jul. 7, 2021.
Prior Publication US 2024/0291886 A1, Aug. 29, 2024
Int. Cl. H04L 67/10 (2022.01)
CPC H04L 67/10 (2013.01) 20 Claims
OG exemplary drawing
 
1. A data processing method for distributed computing executed by an execution workstation, comprising:
splitting an aggregate of a pre-determined data format into a plurality of aggregate fragments;
sending a first portion of aggregate fragments among the plurality of aggregate fragments to a first execution workstation to perform reduction on the first execution workstation;
receiving, from a second execution workstation, aggregate fragments produced by the second execution workstation and corresponding to a second portion of aggregate fragments among the plurality of aggregate fragments and performing reduction on the aggregate fragments received and the second portion of aggregate fragments to update the second portion of aggregate fragments, wherein the first portion is different from the second portion;
re-determining a new first portion of aggregate fragments and a new second portion of aggregate fragments from a remaining portion excluding the first portion of aggregate fragments that have been sent from the plurality of aggregate fragments, and performing the sending, receiving and reduction until each of the plurality of aggregate fragments is sent or completes all reduction; and
in a case that there is an aggregate fragment completing all reduction, sending the aggregate fragment completing all reduction to a management workstation for the management workstation to splice the aggregate fragment completing all reduction with other aggregate fragments completing all reduction into an aggregate.