Evaluating and presenting software testing project status indicators

Patent metadata

Field	Value
Publication number	US-10437707-B2
Application number	US-201514662518-A
Country	US
Kind code	B2
Filing date	Mar 19, 2015
Priority date	Mar 19, 2015
Publication date	Oct 8, 2019
Grant date	Oct 8, 2019

Abstract

Systems and methods for evaluating and presenting software testing project status indicators. An example method may comprise: determining, by a computer system, a plurality of project status indicators comprising one or more average test execution rates, a required test execution rate, a test execution schedule variance, an actual test completion ratio, and/or a test completion schedule variance; and causing one or more project status indicators to be displayed in a visual relation to each other, to a timeline, and/or to another project's status indicators.

First claim

What is claimed is:

1. A method, comprising:
determining, by a computer system, a required test execution rate as a ratio of a number of test instances to be executed to a number of units of time remaining until a project completion date;
determining an average test execution rate as a ratio of a number of test instances that have been executed over a certain period of time to a number of units of time comprised by the certain period of time;
causing the required test execution rate to be presented on a screen via a user interface in a visual relation to the average test execution rate by displaying graphical elements to visually link the required test execution rate and average test execution rate;
determining an actual test execution ratio as a ratio of a number of executed test instances to the number of test instances to be executed;
producing a project timeline comprising a plurality of milestones by interpolating values of expected test execution ratios for calendar dates that do not coincide with dates of the plurality of milestones, wherein each milestone specifies an expected test execution ratio associated with a calendar date, wherein each expected test execution ratio is a ratio of a number of test instances to be executed by the calendar date to a total number of test instances to be executed;
determining, using the project timeline, a test execution schedule variance as of a first date as a number of units of time between the first date and a second date corresponding to the actual test execution ratio;
causing a graph representing the project timeline to be presented on the screen via the user interface, wherein the graph visually represents a first milestone corresponding to the first date and a second milestone corresponding to the second date; and
causing a numeric value representing the test execution schedule variance to be presented on the screen via the user interface in a visual relationship to a portion of the graph between the first milestone and the second milestone.

2. The method of claim 1 , further comprising:
determining an actual test completion ratio based a number of completed test instances and the number of test instances to be executed; and
causing the actual test execution ratio to be presented via the user interface.

3. The method of claim 2 , further comprising:
determining a test completion schedule variance based on the actual test completion ratio; and
causing the test completion schedule variance to be presented via the user interface.

4. The method of claim 1 , further comprising: receiving, from a software testing host computer system, raw project status data is at least one of: a number of executed test instances and a number of failed test instances.

5. The method of claim 1 , further comprising:
determining, by using linear interpolation, an expected test execution ratio for a calendar date between two milestone calendar dates.

6. The method of claim 1 , further comprising:
determining a second average test execution rate as a ratio of a number of test instances that have been executed over a second period of time to a number of units of time comprised by the second period of time; and
producing a graph representing the average test execution rate and the second average test execution rate.

7. A system comprising:
a memory; and
a processor, coupled to the memory, wherein the processor is configured to:
determine a required test execution rate as a ratio of a number of test instances to be executed to a number of units of time remaining until a project completion date;
determine an average test execution rate as a ratio of a number of test instances that have been executed over a certain period of time to a number of units of time comprised by the certain period of time;
cause the required test execution rate to be presented on a screen via a user interface in a visual relation to the average test execution rate by displaying graphical elements to visually link the required test execution rate and average test execution rate;
determine an actual test execution ratio as a ratio of a number of executed test instances to the number of test instances to be executed;
produce a project timeline comprising a plurality of milestones by interpolating values of expected test execution ratios for calendar dates that do not coincide with dates of the plurality of milestones, wherein each milestone specifies an expected test execution ratio associated with a calendar date, wherein each expected test execution ratio is a ratio of a number of test instances to be executed by the calendar date to a total number of test instances to be executed;
determine, using the project timeline, a test execution schedule variance as of a first date as a number of units of time between the first date and a second date corresponding to the actual test execution ratio;
cause a graph representing the project timeline to be presented on the screen via the user interface, wherein the graph visually represents a first milestone corresponding to the first date and a second milestone corresponding to the second date; and
cause a numeric value of the test execution schedule variance to be presented on the screen via the user interface in a visual relationship to a portion of the graph between the first milestone and the second milestone.

8. The system of claim 7 , wherein the processor is further configured to:
determine an actual test completion ratio based a number of completed test instances and the number of test instances to be executed; and
cause the actual test completion ratio to be presented via the user interface.

9. The system of claim 8 , wherein the processor is further configured to:
determine a test completion schedule variance based on the actual test completion ratio and the required test execution rate; and
cause the test completion schedule variance to be presented via the user interface.

10. The system of claim 7 , wherein the processor is further configured to: receive, from a software testing host computer system, raw project status data is at least one of: a number of executed test instances or a number of failed test instances.

11. The system of claim 7 , wherein the processor is further configured to:
determine, by using linear interpolation, an expected test execution ratio for a calendar date between two milestone calendar dates.

12. The system of claim 7 , wherein the processor is further configured to:
determine a second average test execution rate as a ratio of a number of test instances that have been executed over a second period of time to a number of units of time comprised by the second period of time; and
produce a graph representing the average test execution rate and the second average test execution rate.

13. A computer-readable non-transitory storage medium comprising executable instructions that, when executed by a computer system, cause the computer system to:
determine a required test execution rate as a ratio of a number of test instances to be executed to a number of units of time remaining until a project completion date;
determine an average test execution rate as a ratio of a number of test instances that have been executed over a certain period of time to a number of units of time comprised by the certain period of time; and
cause the required test execution rate to be presented on a screen via a user interface in a visual relation to the average test execution rate by displaying graphical elements to visually link the required test execution rate and average test execution rate;
determine an actual test execution ratio as a ratio of a number of execute

Assignees

• Teachers Insurance And Annuity Ass Of America

Inventors

• Blandford Scott Matthew
• Gouin James Paul
• Gonsalves Andrea Joan
• Schweiger Steven Antony
• Salunkhe Sampada Sanjay
• Buckshi Donald Robert
• Russell Paul Jeffrey
• Lomax Brian David
• White David Robert
• Dangur Ido

Classifications

• G06Q10/0639

  Performance analysis of employees; Performance analysis of enterprise or organisation operations · CPC title

• G06F11/3664 Primary

  Physics · mapped topic

• G06F11/3698 Primary

  Environments for analysis, debugging or testing of software · CPC title