US 12,481,946 B2
Resource provisioning by a reinforcement learning framework using guided ordering of services
Tong Yu, San Jose, CA (US); and Kanak Mahadik, San Jose, CA (US)
Assigned to ADOBE INC., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on Mar. 10, 2023, as Appl. No. 18/120,088.
Prior Publication US 2024/0303569 A1, Sep. 12, 2024
Int. Cl. G06Q 10/0631 (2023.01); G06N 20/00 (2019.01)
CPC G06Q 10/06316 (2013.01) [G06N 20/00 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
accessing, by at least one server of one or more servers of a resource provisioning system of a computing environment for which manual provisioning is impractical due to a number of microservices in the computing environment, service resource information indicating computer resource usage of each of a plurality of microservices operating in the computing environment, the computing environment comprising a plurality of physical computer resources including central processing units (CPUs), memory devices, storage devices, and network interfaces;
performing, by at least one server of the one or more servers of the resource provisioning system, a similarity analysis on the service resource information to generate similarity scores for each of the plurality of microservices;
ordering, by at least one server of the one or more servers of the resource provisioning system, the service resource information into a service order based on a closeness between the similarity scores of the microservices;
generating, by a reinforcement learning agent operating on at least one server of the one or more servers of the resource provisioning system, a resource configuration determination for at least one microservice of the plurality of microservices by the reinforcement learning agent processing the service resource information in the service order determined based on the similarity scores of the microservices;
providing the resource configuration determination to a provisioning component associated with the computing environment; and
provisioning, by the provisioning component, a portion of the plurality of physical computer resources of the computing environment for the at least one microservice, the provisioning comprising automatically modifying the portion of the physical computer resources in accordance with the resource configuration determination, the modifying by the provisioning component including adjusting one or more of the CPUs, the memory devices, the storage devices, and/or the network interfaces of the computing environment.