Software testing optimizer

Patent metadata

Field	Value
Publication number	US-9703686-B2
Application number	US-201615132559-A
Country	US
Kind code	B2
Filing date	Apr 19, 2016
Priority date	Dec 5, 2014
Publication date	Jul 11, 2017
Grant date	Jul 11, 2017

Abstract

In an approach for testing software, a computer receives a series of two or more revisions to a set of software code. The computer identifies modifications between the series of two or more revisions. The computer categorizes the series of two or more revisions into one or more categories of revisions based on the identified modifications. The computer tests at least one of the series of two or more revisions from at least one of the one or more categories of revisions.

First claim

What is claimed is:

1. A method for testing software, the method comprising:
receiving, by one or more computer processors, a series of two or more revisions to a set of software code;
identifying, by one or more computer processors, modifications between the series of two or more revisions;
categorizing, by one or more computer processors, the series of two or more revisions into one or more categories of revisions based on the identified modifications;
identifying, by one or more computer processors, one or more critical revisions within the categorized series of two or more revisions;
determining, by one or more computer processors, a critical revision from the identified one or more critical revisions;
testing, by one or more computer processors, the determined critical revision;
determining, by one or more computer processors, whether the tested critical revision passed;
responsive to determining the tested critical revision failed; determining, by one or more processors, whether a previous untested critical revision remains in the identified one or more critical revisions;
identifying, by one or more computer processors, the previous untested critical revision respective to the tested critical revision; and
testing, by one or more computer processors, the identified previous untested critical revision.

2. The method of claim 1 , wherein identifying modifications between the series of two or more revisions comprises:
identifying, by one or more computer processors, a first revision and a second revision within the series of two or more revisions, wherein the first revision occurs immediately prior to the second revision; and
identifying, by one or more computer processors, a number of modifications between the first revision and the second revision based on one or more of: a number of added lines of source code, a number of changed lines of source code, and a number of deleted lines of source code.

3. The method of claim 2 , further comprising:
retrieving, by one or more computer processors, one or more historical data values, wherein the one or more historical data values tracks a number of times a failure occurs with the identified modifications for the series of two or more revisions;
calculating, by one or more computer processors, one or more weighted values by applying predetermined weights to the one or more retrieved historical data values and the identified modifications for the series of two or more revisions; and
calculating, by one or more computer processors, overall revision scores for revisions included in the series of two or more revisions based on the one or more calculated weighted values.

4. The method of claim 1 , wherein categorizing the series of two or more revisions to the set of software into one or more categories of revisions comprises:
determining, by one or more computer processors, a highest overall revision score from overall revision scores;
calculating, by one or more computer processors, a threshold as a percentage of the highest overall revision score;
identifying, by one or more computer processors, one or more revisions from the series of two or more revisions with corresponding determined overall revision scores equal to or greater than the calculated threshold to be critical revisions; and
identifying, by one or more computer processors, one or more revisions from the series of two or more revisions with corresponding determined overall revision scores less than the calculated threshold to be trivial revisions.

5. The method of claim 1 , further comprising:
determining by one or more computer processors, a sample space wherein the sample space comprises one of:
one or more trivial revisions between a passing critical revision and a failing critical revision in the series of two or more revisions;
one or more trivial revisions between a failing critical revision and an oldest trivial revision in the series of two or more revisions; and
one or more trivial revisions between a passing critical revision and a most recent trivial revision in the series of two or more revisions.

6. The method of claim 5 , further comprising:
determining, by one or more computer processors, whether the determined sample space includes one or more trivial revisions;
responsive to determining that the determined sample space includes one or more trivial revisions, identifying, by one or more computer processors, a middle trivial revision from the determined sample space;
testing, by one or more computer processors, the identified middle trivial revision; and
determining, by one or more computer processors, whether the tested middle trivial revision passed.

7. The method of claim 6 , further comprising:
responsive to determining the tested middle trivial revision failed, determining, by one or more computer processors, a reduced sample space, wherein the reduced sample space includes the tested middle trivial revisions and trivial revisions that occur prior to the tested middle trivial revision;
determining, by one or more computer processors, whether the reduced sample space is empty; and
responsive to determining the reduced sample space is not empty, determining, by one or more computer processors, another middle trivial revision to test.

8. The method of claim 6 , further comprising:
responsive to determining the tested middle trivial revision passed, determining by one or more computer processors a reduced sample space wherein the reduced sample space includes trivial revisions that occur after the tested middle trivial revision;
determining, by one or more computer processors, whether the reduced sample space is empty;
responsive to determining the reduced sample space is not empty, determining, by one or more computer processors, another middle trivial revision to test.

9. A computer program product for testing software, the computer program product comprising:
one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising:
program instructions to receive a series of two or more revisions to a set of software code;
program instructions to identify modifications between the series of two or more revisions;
program instructions to categorize the series of two or more revisions into one or more categories of revisions based on the identified modifications wherein the one or more categories of revisions include critical revisions and trivial revisions;
program instructions to identify one or more critical revisions within the categorized series of two or more revisions;
program instructions to determine a critical revision from the identified one or more critical revisions;
program instructions to test the determined critical revision;
program instructions to determine whether the tested critical revision passed;
responsive to determining the tested critical revision failed; program instructions to determine whether a previous untested critical revision remains in the identified one or more critical revisions;
program instructions to identify the previous untested critical revision respective to the tested critical revision; and
program instructions to test the identified previous untested critical revision.

10. The computer program product of claim 9 , wherein to identify modifications between the series of two or more revisions comprises program instructions, stored on the one or more computer readable storage media, to:
identify a first revision and a second revision within the series of two or more revisions, wherein the first revision occurs immediately prior to the second revision; and
identify a number of modifications betwee

Assignees

• IBM

Inventors

• Dos Santos Tiago N
• Folco Rafael C S
• Leitao Breno H

Classifications

• G06F11/008

  Reliability or availability analysis · CPC title

• G06F11/3668 Primary

  Testing of software · CPC title

• G06F11/3688

  for test execution, e.g. scheduling of test suites · CPC title