US 12,475,027 B2
Systems and methods for regression testing using artificial intelligence
Govardana Sachithanandam Ramachandran, Palo Alto, CA (US); Yingbo Zhou, Palo Alto, CA (US); Madhuri Gore, San Francisco, CA (US); Susan Putvin, Alamo, CA (US); Hari Krishna Pottabathula, Hyderabad (IN); and Ganeswara Rao Dulam, Vancouver (CA)
Assigned to Salesforce, Inc., San Francisco, CA (US)
Filed by Salesforce, Inc., San Francisco, CA (US)
Filed on Oct. 3, 2022, as Appl. No. 17/937,652.
Prior Publication US 2024/0118995 A1, Apr. 11, 2024
Int. Cl. G06F 9/44 (2018.01); G06F 11/3668 (2025.01)
CPC G06F 11/3688 (2013.01) [G06F 11/3684 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for regression testing, the method comprising:
providing a regression testing network model for a first plurality of organizations using a common codebase, wherein the regression testing network model provides an organization finite state machine (FSM) model for each organization, wherein the FSM model includes:
a state transition probability associated with a plurality of test artifacts of the first plurality of organizations; and
a posterior probability to have at least one test artifact to fail at a Tth release using the state transition probability, wherein T is an integer number greater than 0;
receiving, via a data interface, a first dataset including samples of the organization FSM models based on regression testing for one or more previous releases of the common codebase prior to the Tth release of the common codebase;
generating a training dataset based on the first dataset;
training the regression testing network model using the training dataset;
receiving a desired bug coverage percentage;
providing a plurality of sample organizations from the first plurality of organizations;
determining, using the trained regression testing network model, an organization test budget indicating a maximum number of organizations to test for the Tth release based on the desired bug coverage percentage and the plurality of sample organizations;
determining, based on the organization test budget, from the first plurality of organizations using the trained regression testing network model, a selected subset of organizations for regression testing for the Tth release; and
performing, only on the selected subset of organizations, regression testing for the Tth release.