US 12,067,378 B2
Selecting a sample set of cloud computing resources for A/B testing of a software deployment
Mathieu Baptiste Demarne, Seattle, WA (US); and Miso Cilimdzic, Laguna Niguel, CA (US)
Assigned to MICROSOFT TECHNOLOGY LICENSING, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Nov. 28, 2022, as Appl. No. 18/059,163.
Application 18/059,163 is a continuation of application No. 17/193,399, filed on Mar. 5, 2021, granted, now 11,537,378.
Prior Publication US 2023/0089231 A1, Mar. 23, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 8/60 (2018.01); G06F 9/50 (2006.01); G06F 8/65 (2018.01)
CPC G06F 8/60 (2013.01) [G06F 9/5027 (2013.01); G06F 8/65 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for dynamically selecting a sample set of cloud computing resources for participating in a deployment test of particular software, the system comprising:
one or more processors; and
one or more memory devices that store program code to be executed by the one or more processors, the program code comprising:
a selection manager that:
selects a candidate subset of a plurality of cloud computing resources of a cloud computing provider for participating in the software deployment test of the particular software based at least on a selected subset of a plurality of customers associated with one or more of the plurality of cloud computing resources, aspects of the particular software, and telemetry data comprising measurements collected from the plurality of cloud computing resources; and
randomly selects the sample set of cloud computing resources for participating in the software deployment test of the particular software from among the candidate subset; and
a software deployment manager that:
deploys the particular software in the sample set of cloud computing resources; and
executes the software deployment test of the particular software in the sample set of cloud computing resources.