| CPC G06F 11/3696 (2013.01) [G06F 11/3668 (2013.01)] | 20 Claims |
|
1. A computer-implemented method comprising:
in a software testing environment comprising a communication link between a software test orchestration tool and a reliability condition dashboard, receiving from the software test orchestration tool software test results at an application level of granularity, wherein the software test results comprise a plurality of reliability status category indicators for a plurality of software applications, wherein the reliability status indicators comprise an indication of pass and an indication of fail;
calculating a reliability metric based on the plurality of reliability status category indicators for the plurality of software applications, wherein the reliability metric incorporates non-binary reliability status category indicators configured to have more than two different values, and at least one of the non-binary reliability status category indicators comprises a value indicating that an error result has been manually overridden as having a testing-related error determined to be harmless;
displaying the reliability metric in a user interface of the reliability condition dashboard;
receiving a reliability metric threshold for the reliability metric; and
responsive to determining that the reliability metric does not meet the reliability metric threshold, blocking an attempted release of a software program for which the software test results are received.
|