US 12,236,265 B2
Error avoidance load balancing across distributed clustered containerized environments
Boris Shpilyuck, Ashdod (IL); Jehuda Shemer, Kfar Saba (IL); and Igor Dubrovsky, Beer Sheva (IL)
Assigned to DELL PRODUCTS L.P., Round Rock, TX (US)
Filed by Dell Products L.P., Round Rock, TX (US)
Filed on Dec. 29, 2021, as Appl. No. 17/565,406.
Prior Publication US 2023/0205578 A1, Jun. 29, 2023
Int. Cl. G06F 9/48 (2006.01)
CPC G06F 9/4881 (2013.01) 20 Claims
OG exemplary drawing
 
1. A system, comprising:
at least one processor; and
at least one memory that stores executable instructions that, when executed by the at least one processor, execute operations comprising:
receiving a plurality of requests of different request types;
serving the requests of the plurality of requests with different container clusters, wherein the container clusters host respective instances of a group of microservices, and wherein multiple microservices of the group of microservices exchange information to provide a service in response to the requests;
receiving respective health statuses of respective microservices of the respective instances of the group of microservices, wherein a correlation exists between respective requests of the requests and respective subgroups of microservices of the group of microservices, and wherein a subgroup of container clusters of the container clusters is available to serve a first request type based on the respective subgroups of microservices of the group of microservices and the respective health statuses for respective microservices of respective instances of the group of microservices;
caching a mapping between the request types and corresponding subgroups of the container clusters that are able to serve the request types in a cache;
receiving a subsequent request of the a second request type; and
sending an indication of failure of the subsequent request when there is no container cluster of the container clusters available to serve the subsequent request based on the cached mapping and the respective health statuses of the respective microservices of the respective instances of the group of microservices.