US 11,863,613 B1
Allocation of workloads in dynamic worker fleet
Mihir Sathe, Seattle, WA (US); Aravind Srinivasan, Ellicott City, MD (US); and Pranav Rao Perampalli Nekkar, Seattle, WA (US)
Assigned to Amazon Technologies, Inc., Seattle, WA (US)
Filed by Amazon Technologies, Inc., Seattle, WA (US)
Filed on Mar. 22, 2021, as Appl. No. 17/209,008.
Int. Cl. H04L 67/1008 (2022.01)
CPC H04L 67/1008 (2013.01) 21 Claims
OG exemplary drawing
 
1. A system comprising:
a fleet of server computing devices configured to implement workloads on behalf of client computing devices, wherein individual server computing devices are associated with ages reflecting their relative time within the fleet; and
one or more load balancer devices configured to:
obtain age data reflecting the ages of the individual server computing devices;
generate a relative probability distribution based on application of the age data to a probability density function, wherein the probability density function reflects relative probabilities to randomly select a server computing device from the fleet, wherein the relative probabilities are determined at least in part as a function of age of the individual server computing devices, and wherein the relative probabilities bias against selection of younger server computing devices relative to older server computing devices;
obtain a request to route a workload to the fleet;
select a plurality of server computing devices at random from the fleet according to the relative probability distribution;
identify a least loaded server computing device from the plurality of server computing devices; and
route the workload to the least loaded server computing device selected from the plurality of server computing devices.