Streamlined testing experience

Patent metadata

Field	Value
Publication number	US-9507699-B2
Application number	US-201113161690-A
Country	US
Kind code	B2
Filing date	Jun 16, 2011
Priority date	Jun 16, 2011
Publication date	Nov 29, 2016
Grant date	Nov 29, 2016

Abstract

Tests can be categorized as important with respect to ensuring software functions correctly as a function of one or more rules that define importance. The rules can be configurable to enable control of categorization. Further, tests categorized as important can be highlighted in some manner, for instance by displaying important tests in a group designated for such tests.

First claim

What is claimed is:

1. A method facilitating software testing, comprising:
employing at least one processor configured to execute computer-executable instructions stored in memory to perform the following acts:
identifying one or more predefined rules that define importance with respect to software tests based on one or more metrics associated with at least one of a test or software under test, wherein at least one of the one or more predefined rules defines a test as important if the test previously passed but has not passed within a predetermined time;
categorizing one or more software tests as important or unimportant in ensuring software functions correctly at a given time as a function of the one or more predefined rules;
displaying one or more tests categorized as important in a group; and
providing a mechanism to initiate execution of the one or more tests categorized as important in the group.

2. The method of claim 1 further comprises categorizing the one or more software tests as a function of one or more configurable rules.

3. The method of claim 1 further comprises categorizing the one or more software tests as a function of one of the one or more predefined rules that defines the test as important if the test has not passed within a predetermined time.

4. The method of claim 1 further comprises categorizing the software test as a function of one of the one or more predefined rules that defines the test as important if the test executes over at least a portion of code that has changed.

5. The method of claim 1 further comprising ordering the group of two or more tests as a function of a test property.

6. The method of claim 1 further comprises displaying an identifier indicative of test execution state of each test classified as important.

7. The method of claim 1 further comprises denoting the test as important in source code of the test.

8. The method of claim 1 further comprises providing a mechanism to initiate execution of two or more tests categorized as important in the group in response to a single gesture.

9. A system, comprising:
a processor coupled to a memory, the processor configured to execute the following computer-executable components stored in the memory:
a categorization component that identifies one or more software tests as important to run based on one or more predefined rules that define importance as a function of one or more metrics associated with at least one of a test or software under test, wherein at least one of the one or more predefined rules defines a test as important if the test previously passed but has not passed within a predetermined time; and
an interface component that displays one or more software tests, identified as important to run at a given time in a testing workflow as a function of the one or more predefined rules, in a group designated solely to important tests and distinct from unimportant tests, and provides a mechanism to initiate execution of the one or more software tests in the group designated solely for important tests.

10. The system of claim 9 , the interface component further displays the one or more software tests in one or more sub-groups of the group.

11. The system of claim 9 , the interface component further displays the one or more software tests in a predetermined order.

12. The system of claim 9 , the interface component further displays an identifier indicative of test state for at least one or the one or more software tests.

13. The system of claim 9 , one of the one or more software tests is identified as important to run if code over which the test operates changes.

14. The system of claim 9 , the interface component further provides a mechanism to initiate execution of two or more of the one or more software tests in the group in response to a single gesture.

15. A computer-readable storage medium having instructions stored thereon that enable at least one processor to perform a method upon execution of the instructions, the method comprising:
identifying one or more predefined rules that define importance with respect to software tests based on one or more metrics associated with at least one of a test or software under test, wherein at least one of the one or more predefined rules defines a test as important if the test previously passed but has not passed within a predetermined time;
categorizing a unit test as important or unimportant as a function of the one or more predefined rules; and
providing a mechanism to initiate execution of a group of one or more unit tests categorized as important.

16. The computer-readable storage medium of claim 15 , the method further comprises categorizing the unit test as important based on a rule if code over which the test operates changes.

17. The computer-readable storage medium of claim 15 , the method further comprises displaying a group of unit tests categorized as important.

18. The computer-readable storage medium of claim 15 further comprises providing a mechanism to initiate execution of a group of two or more unit tests categorized as important in response to a single gesture.

Assignees

• Provost Peter G
• Bavey Ian M
• King Todd L
• Calvo-Rodriguez Oscar
• Wilson Bradley J
• Microsoft Technology Licensing Llc

Inventors

• Provost Peter G
• Bavey Ian M
• King Todd L
• Calvo-Rodriguez Oscar
• Wilson Bradley J

Classifications

• G06F11/3688 Primary

  for test execution, e.g. scheduling of test suites · CPC title

• G06F11/3409

  for performance assessment · CPC title

• G06F11/3684

  for test design, e.g. generating new test cases · CPC title