US 11,838,356 B2
Weighted auto-sharing
Alexander Shraer, Stanford, CA (US); Kfir Lev-Ari, Kfar Saba (IL); Arif Merchant, Mountain View, CA (US); Vishesh Khemani, Seattle, WA (US); and Atul Adya, Palo Alto, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on May 16, 2022, as Appl. No. 17/663,618.
Application 17/663,618 is a continuation of application No. 16/725,472, filed on Dec. 23, 2019, granted, now 11,363,096.
Application 16/725,472 is a continuation of application No. 15/428,844, filed on Feb. 9, 2017, granted, now 10,530,844, issued on Jan. 7, 2020.
Claims priority of provisional application 62/345,567, filed on Jun. 3, 2016.
Prior Publication US 2022/0272148 A1, Aug. 25, 2022
Int. Cl. H04L 67/1001 (2022.01); G06F 9/50 (2006.01); G06F 16/00 (2019.01); G06F 16/27 (2019.01); H04L 43/08 (2022.01); H04L 67/148 (2022.01)
CPC H04L 67/1001 (2022.05) [G06F 9/5066 (2013.01); G06F 9/5083 (2013.01); G06F 9/5088 (2013.01); G06F 16/00 (2019.01); G06F 16/278 (2019.01); H04L 43/08 (2013.01); H04L 67/148 (2013.01); G06F 2209/5017 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method executed by data processing hardware that causes the data processing hardware to perform operations comprising:
partitioning a data set for an application job into a plurality of partitions based on a key;
assigning, to each worker computer in a set of worker computers, one or more partitions of the plurality of partitions;
receiving, from each respective worker computer in the set of worker computers, a respective load measure indicating a computational load of the respective worker computer;
determining, using the respective load measure of each respective worker computer, a weight of a move operation for moving at least one partition from a first worker computer of the set of worker computers to a second worker computer of the set of worker computers;
determining that the weight of the move operation satisfies a threshold; and
in response to determining that the weight of the move operation satisfies the threshold, moving the at least one partition from the first worker computer of the set of worker computers to the second worker computer of the set of worker computers.