US 12,141,097 B2
Method and system for providing pre-approved A/A data buckets
Russell Chen, Oakland, CA (US); Miao Chen, Sunnyvale, CA (US); Don Matheson, Denver, CO (US); and Mahendrasinh Ramsinh Jadav, San Jose, CA (US)
Assigned to YAHOO ASSETS LLC, New York, NY (US)
Filed by YAHOO ASSETS LLC, New York, NY (US)
Filed on Aug. 4, 2023, as Appl. No. 18/365,558.
Application 18/365,558 is a continuation of application No. 17/467,127, filed on Sep. 3, 2021, granted, now 11,726,958.
Application 17/467,127 is a continuation of application No. 15/677,724, filed on Aug. 15, 2017, granted, now 11,226,931.
Prior Publication US 2023/0385238 A1, Nov. 30, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/14 (2019.01); G06F 12/1018 (2016.01); G06F 16/2457 (2019.01); G06F 16/435 (2019.01); G06Q 50/10 (2012.01); G16H 10/40 (2018.01); H04L 67/02 (2022.01); H04L 67/50 (2022.01)
CPC G06F 16/152 (2019.01) [G06F 12/1018 (2013.01); G06F 16/24578 (2019.01); G06F 16/435 (2019.01); G06Q 50/10 (2013.01); G16H 10/40 (2018.01); H04L 67/02 (2013.01); H04L 67/535 (2022.05)] 11 Claims
OG exemplary drawing
 
1. A method for providing pre-validated data buckets for online experiments, comprising:
obtaining historical user activity data representing online activities of a plurality of users each having a corresponding user identifier;
hashing each of the plurality of user identifiers to obtain a plurality of hash values;
obtaining a set of metric values based on the historical user activity data, wherein the set of metric values represents user engagement of the plurality of users;
ranking the plurality of hash values of the plurality of users based on the set of metric values to obtain a ranked list of hash values; and
removing one or more of hash values from the ranked list based on an exclusion range rule provided for excluding users with hash values in a predetermined range, wherein the remaining hash values in the ranked list are to be placed in a data bucket for an online experiment, wherein the exclusion range rule indicates to exclude the one or more of hash values flagged by a metadata tag, and wherein the metadata tag indicates that the one or more of hash values are either unavailable for placement or should not be used in the data bucket for the online experiment.