US 11,888,927 B2
System and method for fast application auto-scaling
Nirmal Parekh, Glen Allen, VA (US); Zachary Abrahamson, Moseley, VA (US); Mahesh Veerabathiran, Henrico, VA (US); Sathish Gampa, Plano, TX (US); and Steven Pearson, Plano, TX (US)
Assigned to Capital One Services, LLC, McLean, VA (US)
Filed by Capital One Services, LLC, McLean, VA (US)
Filed on Dec. 29, 2021, as Appl. No. 17/564,936.
Application 17/564,936 is a continuation of application No. 16/430,888, filed on Jun. 4, 2019, granted, now 11,228,643.
Prior Publication US 2022/0124145 A1, Apr. 21, 2022
Int. Cl. H04L 67/1001 (2022.01); G06F 9/445 (2018.01); G06F 9/455 (2018.01); H04L 43/08 (2022.01); H04L 47/70 (2022.01)
CPC H04L 67/1001 (2022.05) [G06F 9/44505 (2013.01); G06F 9/45558 (2013.01); H04L 43/08 (2013.01); H04L 47/827 (2013.01); G06F 2009/45562 (2013.01); G06F 2009/45595 (2013.01)] 20 Claims
OG exemplary drawing
 
8. An apparatus, the apparatus comprising:
a processor; and
memory comprising instructions that when executed by the processor cause the processor to:
generate a plurality of custom machine images of one or more virtual servers, wherein at least one of the plurality of custom machine images is configured with a first initialized application state for an application and the at least one custom machine image configured with the first initialized state for the application includes a template for a root volume for use by an agent built using the at least one custom machine image configured with the first initialized state for the application;
monitor metric data of a pool of servers to detect a performance issue in providing the application, the pool of servers comprising a plurality of resources for the one or more virtual servers to support requests to access one or more applications;
detect the performance issue based on the monitoring of the metric data; and
in response to detecting the performance issue:
determining whether a custom machine image has been previously generated for the application,
deploying a serverless instance of the at least one custom machine image configured with the first initialized state for the application to the pool of servers to provide the application responsive to determining that the custom machine image has been previously generated for the application, the serverless instance generated via an instance generation service operative to translate the custom machine image into an object comprising initialized program code of the custom machine image that, when executed, is operative to provide a sequence of one or more functions to emulate an operation of a corresponding virtual server of the custom machine image to provide the application without requiring deployment of the corresponding virtual server,
deploying a virtual server for the application responsive to determining that the custom machine image has not been previously generated for the application, and
generating the custom machine image for the virtual server following provisioning and booting of the virtual server.