Adaptive software testing

Patent metadata

Field	Value
Publication number	US-10846206-B2
Application number	US-201715622851-A
Country	US
Kind code	B2
Filing date	Jun 14, 2017
Priority date	Jun 14, 2017
Publication date	Nov 24, 2020
Grant date	Nov 24, 2020

Abstract

In a software testing environment, a test script may be designed to search among outputs of an in-test target application for an expected output element having a specified property. A test execution engine executes the test script, and if such an output is not found, and the test script returns a “fail” result, the test execution engine revises the test script so that rather than searching for the originally specified property, the test script searches for a different property, where the different property is a property that the expected output element was observed to have during a previous execution of the test script. The test execution engine then executes the revised test script and reports its results.

First claim

What is claimed is:

1. A method, comprising:
obtaining a test script for a test case, wherein the test script is configured to (a) simulate user input to a target application, resulting in one or more application output elements, and (b) attempt to find an expected output element, among the one or more application output elements, that has a first property associated with a content of the expected output element;
executing the test script against the target application to cause the target application to produce the one or more application output elements, wherein the test script is unable to find the expected output element among the one or more application output elements;
determining whether the first property is a critical property; and
if the first property is not a critical property then:
identifying a second property, associated with the content of the expected output element, that the expected output element had during a previous execution of the test script, wherein the second property is different than the first property;
revising the test script so that a revised test script attempts to find the expected output element by identifying one of the one or more application output elements that has the second property, wherein the revised test script comprises the second property; and
executing the revised test script against the target application, wherein the revised test script is able to find the expected output element among the one or more application output elements.

2. The method of claim 1 , further comprising recording one or more additional properties, other than the first property, that the expected output element had during the previous execution of the test script, wherein the second property is one of the one or more additional properties.

3. The method of claim 1 , wherein identifying the second property comprises selecting the second property from among one or more additional properties, associated with the content of the expected output element, that the expected output element had during the previous execution of the test script.

4. The method of claim 3 , wherein the expected output element is a user interface element and the one or more additional properties include any one or more of the following properties associated with the content of the user interface element:
content of the interface element;
an output value of the interface element;
a color of the interface element;
text presented by the interface element;
help text presented by the interface element;
possible user selections that are available in the interface element;
an icon presented by the interface element;
a context menu presented by the interface element;
a control presented by interface element;
a default input value of the interface element; or
a resource associated with the interface element.

5. The method of claim 1 , wherein the second property comprises a name or programmatic identifier that the expected output element had during the previous execution of the test script.

6. The method of claim 1 , wherein the second property comprises content of the expected output element during the previous execution of the test script.

7. The method of claim 1 , and further comprising:
if the first property is a critical property then reporting a fail result for the test case.

8. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform actions comprising:
obtaining a test script for a test case, wherein the test script is configured to attempt to find an expected output element, among one or more application output elements, that has a first property associated with a content of the expected output element;
executing the test script, wherein the test script is unable to find the expected output element among the one or more application output elements;
determining whether the first property is a critical property; and
if the first property is not a critical property then:
revising the test script so that it attempts to find the expected output element by identifying one of the one or more application output elements that has a second property associated with the content of the expected output element and that the content of the expected output element had during a previous execution of the test script, wherein the revised test script comprises the second property.

9. The one or more non-transitory computer-readable media of claim 8 , the actions further comprising recording one or more additional properties, other than the first property, of the expected output element during the previous execution of the test script, wherein the second property is one of the one or more additional properties.

10. The one or more non-transitory computer-readable media of claim 8 , wherein:
the expected output element is a user interface element;
the first property comprises a programmatic identifier of the user interface element; and
the second property comprises a name that was associated with the content of the user interface element during a previous execution of the test script.

11. The one or more non-transitory computer-readable media of claim 8 , wherein the second property comprises content that the expected output element had during a previous execution of the test script.

12. The one or more non-transitory computer-readable media of claim 8 , the actions further comprising selecting the second property from among one or more additional properties that the expected output element had during the previous execution of the test script.

13. The one or more non-transitory computer-readable media of claim 12 , wherein the expected output element is a user interface element and the one or more additional properties include any one or more of the following properties associated with the content of the user interface element:
content of the interface element;
an output value of the interface element;
a color of the interface element;
text presented by the interface element;
help text presented by the interface element;
possible user selections that are available in the interface element;
an icon presented by the interface element;
a context menu presented by the interface element;
a control presented by interface element;
a default input value of the interface element; or
a resource associated with the interface element.

14. The one or more non-transitory computer-readable media of claim 8 wherein, if the first property is a critical property, the actions further comprise:
reporting a fail result for the test case.

15. A method, comprising:
obtaining a test script for a test case, wherein the test script is configured to (a) provide input to a target application, resulting in one or more application output elements, and (b) attempt to find an expected output element, among the one or more application output elements, that has a first property associated with a content of the expected output element;
executing the test script against the target application to cause the target application to produce the one or more application output elements, wherein the test script is unable to find the expected output element among the one or more application output elements;
determining whether the first property is a critical property; and
if the first property is not a critical property then:
determining that a particular output element, among the one or more application output elements, is the expected output element, wherein the particular output element has a second proper

Assignees

• T Mobile Usa Inc

Inventors

• Myron Peter P
• Mitchell Michael J
• Kwong Samson Kim-Sun

Classifications

• G06F11/3698

  Environments for analysis, debugging or testing of software · CPC title

• G06F11/3688 Primary

  for test execution, e.g. scheduling of test suites · CPC title

• G06F11/3684 Primary

  for test design, e.g. generating new test cases · CPC title

• G06F11/3664

  Physics · mapped topic