US 11,909,655 B1
Systems and methods for selective deployment of experimental configurations to mutually exclusive groups
Aldi Tjahjadi, Mountain View, CA (US); ZhaoPing Yan, Mountain View, CA (US); Ngoc-Lan Isabelle Phan, Burlingame, CA (US); and Jean-Baptiste Rieu, Paris (FR)
Assigned to COUPANG CORP., Seoul (KR)
Filed by COUPANG CORP., Seoul (KR)
Filed on Aug. 9, 2022, as Appl. No. 17/883,922.
Int. Cl. H04L 47/2475 (2022.01); H04L 47/62 (2022.01)
CPC H04L 47/2475 (2013.01) [H04L 47/6215 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for selective deployment of experimental configurations, the computer-implemented method comprising:
deploying a webpage comprising a plurality of configurations, wherein the plurality of configurations exhibit different behaviors;
configuring a traffic container comprising a first bucket and a second bucket based on user input;
assigning one or more experiments to the traffic container based on the user input, wherein the one or more experiments determine appropriate configurations among the plurality of configurations for the first bucket and the second bucket, wherein assigning the one or more experiments includes:
determining current assignments of the one or more experiments; and
generating a message based on the current assignments and an indication that the one or more experiments will be reassigned;
accepting incoming traffic for accessing the webpage;
randomly assigning a first subset of the incoming traffic to the first bucket and a second subset of the incoming traffic to the second bucket;
transmitting the webpage in the appropriate configurations based on the random assignments; and
obtaining one or more measurements indicative of relative performances of the appropriate configurations.