| CPC G06F 11/3676 (2013.01) [G06F 11/3612 (2013.01); G06F 11/3664 (2013.01); G06F 11/3684 (2013.01); G06F 11/3688 (2013.01); G06F 3/065 (2013.01); G06F 16/128 (2019.01)] | 10 Claims |

|
1. A method to live test a service in a production environment, where the service is provided by a set of configured instances in the production environment, and each configured instance is composed of a set of components, the method comprising:
instantiating components under test from the set of components to setup paths that are to be taken by test traffic;
instantiating test configuration components from the set of components for the service;
executing a test case on a created path;
generating a snapshot of a first serving component from the set of components;
replacing a tested component under test from the set of components with a second serving component from the set of components cloned from the snapshot;
relocating the service to the second serving component;
replacing the first serving component of the snapshot with a new component under test to create a new path to be tested;
determining whether all paths have been tested; and
reducing a number of paths to be tested using boundary environments and coverage criteria, wherein reducing the number of paths to be tested using the boundary environments and coverage criteria, wherein the coverage criteria include any one or more of a first coverage criteria is testing on all paths that chain mixtures of the set of configured instances involved in the test case, a second coverage criteria is testing pairwise boundary environment mixtures where a set of paths with each pair of identified mixtures being in at least one of the set of paths, a third coverage criteria is testing all boundary environment mixtures, a fourth coverage criteria is testing all boundary environment paths for each path that chains boundary environments of the set of configured instances in the test case, or a fifth coverage criteria is testing pairwise boundary environments where possible boundary environments are identified and a set of paths generated where each pair of identified boundary environments are in at least one path, wherein the first coverage criteria to the fifth coverage criteria are ordered by their error detection power.
|