US 11,704,382 B2
Assigning variants of content to users while maintaining a stable experimental population
Ogden Kent, San Francisco, CA (US); Benjamin David Bader, Boulder, CO (US); and Jeffrey Bernard Arnold, Oakland, CA (US)
Assigned to Maplebear Inc., San Francisco, CA (US)
Filed by Maplebear Inc., San Francisco, CA (US)
Filed on Mar. 25, 2022, as Appl. No. 17/704,101.
Application 17/704,101 is a continuation of application No. 17/180,547, filed on Feb. 19, 2021, granted, now 11,314,836.
Prior Publication US 2022/0269748 A1, Aug. 25, 2022
Int. Cl. G06F 16/958 (2019.01); G06F 16/957 (2019.01); G06F 11/34 (2006.01); G06F 40/143 (2020.01)
CPC G06F 16/9577 (2019.01) [G06F 11/3476 (2013.01); G06F 16/958 (2019.01); G06F 40/143 (2020.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for determining a variant of a web page to provide to a client device, the method comprising:
receiving a first request for a web page from a client device, the web page associated with a plurality of different variants of the web page;
assigning a variant from the plurality of different variants of the web page to a user of the client device;
transmitting the assigned variant to the client device for display on the client device;
receiving a second request for the web page from the client device, the second request received subsequent to the first request;
calculating a performance of each of the plurality of different variants responsive to the second request;
selecting either the assigned variant or another variant from the plurality of different variants to transmit to the client device based on the calculated performance of each of the plurality of different variants; and
transmitting the selected variant to the client device.