Predictive model scoring to optimize test case order in real time

Patent metadata

Field	Value
Publication number	US-2017010959-A1
Application number	US-201514792682-A
Country	US
Kind code	A1
Filing date	Jul 7, 2015
Priority date	Jul 7, 2015
Publication date	Jan 12, 2017
Grant date	—

Abstract

An approach for predictively scoring test case results in real-time. Test case results associated with a test run are received by a software testing environment. Using predictive statistical models, test case results and attribute relationships are matched against model rules and test case history. A statistical correlation and confidence parameter provide the ability to generate test case relationships for predicting the outcome of other test cases in the test run. The test case relationships are transformed into scoring results and output for the further processing.

First claim

What is claimed is:

1 . A method for predictively scoring test case results in real-time, the method comprising:
receiving one or more test case results associated with a test run; determining one or more test case relationships based on at least one of one or more predictive statistical models and test case history, wherein the one or more predictive statistical models are operational on the one or more test case results; transforming the one or more test case relationships into one or more scoring results based on a predetermined correlation criteria; and outputting the one or more scoring results for further processing.

2 . The method of claim 1 , wherein the one or more test case results comprise attributes associated with the one or more test case relationships.

3 . The method of claim 1 , wherein the one or more test case relationships are partially determined by one or more attributes associated with the test case history.

4 . The method of claim 1 , wherein determining comprises data mining historic test results to statistically organize related attributes based on one or more predictive statistical models comprising a priori, regression, clustering, tree and neural network.

5 . The method of claim 1 , wherein predictively scoring test case results is based on predetermined association rules and one or more predictive statistical models.

6 . The method of claim 1 , wherein the scoring results comprise single value output, multi-value output and multi-value prioritized output.

7 . The method of claim 6 , wherein the single-value output is a test case for execution, the multi-value output is a plurality of test cases and statistical correlation and confidence rankings for execution and a multi-value prioritized output is a prioritized plurality of test cases for execution.

8 . A computer program product for predictively scoring test case results in real-time, the computer program product comprising:
one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising:
program instructions to receive one or more test case results associated with a test run;
program instructions to determine one or more test case relationships based on at least one of one or more predictive statistical models and test case history, wherein the one or more predictive statistical models are operational on the one or more test case results;
program instructions to transform the one or more test case relationships into one or more scoring results based on a predetermined correlation criteria; and
program instructions to output the one or more scoring results for further processing.

9 . The computer program product of claim 8 , wherein the one or more test case results comprise attributes associated with the one or more test case relationships.

10 . The computer program product of claim 8 , wherein the one or more test case relationships are partially determined by one or more attributes associated with the test case history.

11 . The computer program product of claim 8 , wherein determining comprises data mining historic test results to statistically organize related attributes based on one or more predictive statistical models comprising a priori, regression, clustering, tree and neural network.

12 . The computer program product of claim 8 , wherein predictively scoring test case results is based on predetermined association rules and one or more predictive statistical models.

13 . The computer program product of claim 8 , wherein the scoring results comprise single value output, multi-value output and multi-value prioritized output.

14 . The computer program product of claim 13 , wherein the single-value output is a test case for execution, the multi-value output is a plurality of test cases and statistical correlation and confidence rankings for execution and a multi-value prioritized output is a prioritized plurality of test cases for execution.

15 . A computer system for predictively scoring test case results in real-time, the computer system comprising:
one or more computer processors; one or more computer readable storage media; program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising:
program instructions to receive one or more test case results associated with a test run;
program instructions to determine one or more test case relationships based on at least one of one or more predictive statistical models and test case history, wherein the one or more predictive statistical models are operational on the one or more test case results;
program instructions to transform the one or more test case relationships into one or more scoring results based on a predetermined correlation criteria; and
program instructions to output the one or more scoring results for further processing.

16 . The computer system of claim 15 , wherein the one or more test case relationships are partially determined by one or more attributes associated with the test case history.

17 . The computer system of claim 15 , wherein determining comprises data mining historic test results to statistically organize related attributes based on one or more predictive statistical models comprising a priori, regression, clustering, tree and neural network.

18 . The computer system of claim 15 , wherein predictively scoring test case results is based on predetermined association rules and one or more predictive statistical models.

19 . The computer system of claim 15 , wherein the predictively scoring results comprise single value output, multi-value output and multi-value prioritized output.

20 . The computer system of claim 19 , wherein the single-value output is a test case for execution, the multi-value output is a plurality of test cases and statistical correlation and confidence rankings for execution and a multi-value prioritized output is a prioritized plurality of test cases for execution.

Assignees

• IBM

Inventors

• Smith Kevin B
• Thompson Andrew J
• Waddling David R

Classifications

• G06F11/3692 Primary

  for test results analysis · CPC title

• G06N5/022 Primary

  Knowledge engineering; Knowledge acquisition · CPC title

• G06F16/24578

  using ranking · CPC title

• G06F11/3688

  for test execution, e.g. scheduling of test suites · CPC title

• G06F16/248

  Presentation of query results · CPC title