US 11,729,258 B2
Service providing system, service providing method, master node, and program
Fumihiko Sawazaki, Musashino (JP)
Assigned to Nippon Telegraph and Telephone Corporation, Tokyo (JP)
Appl. No. 17/800,980
Filed by Nippon Telegraph and Telephone Corporation, Tokyo (JP)
PCT Filed Feb. 26, 2020, PCT No. PCT/JP2020/007571
§ 371(c)(1), (2) Date Aug. 19, 2022,
PCT Pub. No. WO2021/171389, PCT Pub. Date Sep. 2, 2021.
Prior Publication US 2023/0077240 A1, Mar. 9, 2023
Int. Cl. H04L 67/1004 (2022.01); G06F 9/50 (2006.01); H04L 47/122 (2022.01)
CPC H04L 67/1004 (2013.01) [G06F 9/50 (2013.01); H04L 47/122 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A service provision system comprising: a service mesh including a plurality of microservices connected in series; and a master node that manages each of the microservices, wherein
each microservice includes
a plurality of workers each including one or more processors, configured to perform predetermined task processing and
a load balancer, including one or more processors, configured to assign a task received from upstream to one of the workers,
the master node includes
a task processing monitoring unit, including one or more processors, configured to monitor a task processing status in each of the microservices and detects an occurrence of congestion in the service mesh,
a worker allocation unit, including one or more processors, configured to determine an allocation of a number of workers to each of the microservices, and
a processing ratio determination unit, including one or more processors, configured to determine, on a basis of the task processing status in each of the microservices, a ratio of requests on which to perform normal task processing and requests for which to return an error to the source of a service request from among service requests received by a most upstream microservice positioned farthest upstream in the service mesh,
the worker allocation unit is configured to increase the number of workers in the most upstream microservice in a case where the congestion occurs, and
the workers in the most upstream microservice are configured to process the service requests on the basis of the ratio determined by the processing ratio determination unit.