US 11,928,048 B2
Method, system, and computer program product for operating dynamic shadow testing environments
Ranglin Lu, Austin, TX (US); Yu Gu, Austin, TX (US); and Yinhe Cheng, Austin, TX (US)
Assigned to Visa International Service Association, San Francisco, CA (US)
Filed by Visa International Service Association, San Francisco, CA (US)
Filed on Mar. 14, 2023, as Appl. No. 18/121,214.
Application 18/121,214 is a continuation of application No. 17/568,902, filed on Jan. 5, 2022, granted, now 11,630,760.
Application 17/568,902 is a continuation of application No. 16/658,840, filed on Oct. 21, 2019, granted, now 11,249,882, issued on Feb. 15, 2022.
Prior Publication US 2023/0214313 A1, Jul. 6, 2023
Int. Cl. G06F 9/44 (2018.01); G06F 11/36 (2006.01); G06N 20/00 (2019.01); G06Q 20/10 (2012.01)
CPC G06F 11/3664 (2013.01) [G06F 11/362 (2013.01); G06F 11/3696 (2013.01); G06N 20/00 (2019.01); G06Q 20/108 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
generating, with at least one processor, a shadow testing environment operating at least two transaction services, wherein the at least two transaction services comprise a first transaction service executed at least partly with a first machine-learning model and a second transaction service executed at least partly with a second machine-learning model, and wherein the first transaction service is a different version of a same service as the second transaction service;
receiving, with the at least one processor at a transaction processing system of a transaction service provider in an electronic payment processing network, a plurality of transaction authorization requests, each transaction authorization request of the plurality of transaction authorization requests comprising transaction data of a payment transaction associated with a payment device, wherein the transaction processing system is configured to receive the plurality of transaction authorization requests from at least one merchant and process payment transactions associated with the plurality of transaction authorization requests as said payment transactions are initiated by at least one point-of-sale terminal of the at least one merchant;
determining, with at least one processor, a first parameter defining a first testing policy of the first transaction service and a second parameter defining a second testing policy of the second transaction service, wherein the first parameter defines a percent of actively processed data on which to test the first transaction service, and wherein the second parameter defines a percent of actively processed data on which to test the second transaction service;
replicating in the shadow testing environment, with the at least one processor in real-time with the transaction processing system processing the payment transactions, a first portion of the plurality of transaction authorization requests to produce a first set of replicated transaction data, and a second portion of the plurality of transaction authorization requests to produce a second set of replicated transaction data, wherein the first portion is based on the first parameter and the second portion is based on the second parameter; and
testing, with the at least one processor, the first transaction service using the first set of replicated transaction data as input, and the second transaction service using the second set of replicated transaction data as input.