| CPC G06F 8/71 (2013.01) [G06F 8/77 (2013.01)] | 24 Claims |
|
1. An assessment system comprising:
at least one processor operatively connected to a memory, the at least one processor configured to:
calculate a software quality score for a release candidate based on a set of user defined criteria for defining functionality of the release candidate to be tested, the software quality score defining a comprehensiveness of the testing of the release candidate and the comprehensiveness establishing how well a set of tests, when executed, evaluate the functionality defined by the user defined criteria;
calculate a confidence level associated with the software quality score, the confidence level calculated based on one or more dimensions associated with testing the release candidate, the confidence level being indicative of an accuracy of the calculated software quality score based on the one or more dimensions associated with testing the release candidate;
generate a user interface configured to display the software quality score and the confidence level associated with the software quality score;
generate a selectable visual indicator in the user interface and enable operation of the selectable visual indicator responsive to determining that the software quality score meets a predetermined threshold, wherein the selectable visual indicator is configured to: trigger integration of a software build into a software product or trigger release of the software build as a stand alone software product, responsive to selection of the selectable visual indicator in the user interface;
analyze the user defined criteria associated with at least the software quality score or the confidence level, wherein the user defined criteria comprise at least acceptable threshold values associated with testing the release candidate, including at least a minimum value associated with how comprehensively a testing platform evaluates functionality in the release candidate;
determine whether at least a portion of the user defined criteria has not been met;
if said at least a portion of the user defined criteria has not been met based at least in part on a comprehensiveness threshold, disable functionality of the selectable visual indicator;
display a learn more visual indicator;
upon interaction with the learn more visual indicator,
determine summary information for one or more tests that have been conducted;
determine one or more facets effecting the at least acceptable threshold values of the user defined criteria that has not been met by determining a deviation between contribution values associated with the one or more facets contributing to the software quality score and potential contribution values associated with the one or more facets if changes are made to the testing platform, wherein said facets comprise at least a test coverage score, and determine one or more corresponding recommendations for improving the one or more facets so that the at least acceptable threshold values of the user defined criteria will be met, wherein the one or more corresponding recommendations include at least one recommendation for conducting one or more additional tests for improving the test coverage score;
determine projected scores based on the set of user defined criteria used to calculate the software quality score, the projected scores being predictive software quality scores scoring effects on the set of user defined criteria based on if the one or more corresponding recommendations were to be followed, the projected scores compare-able to the software quality score based on the set of user defined criteria and determined prior to the one or more corresponding recommendations being followed;
display the one or more corresponding recommendations, the summary information for the one or more tests that have been conducted, and the projected scores for the user defined criteria if the one or more corresponding recommendations were to be followed;
receive an instruction to perform at least one of the one or more corresponding recommendations when the projected scores meet the at least one acceptable threshold value; and
re-enable the functionality of the selectable visual indicator when said one or more recommendations are satisfied.
|