Application testing

Patent metadata

Field	Value
Publication number	US-2018095869-A1
Application number	US-201515566840-A
Country	US
Kind code	A1
Filing date	Apr 30, 2015
Priority date	Apr 30, 2015
Publication date	Apr 5, 2018
Grant date	—

Abstract

Examples disclosed herein relate to application testing. The examples may enable identifying a set of tests for testing an application and identifying a set of attributes associated with a particular test of the set of tests. The set of attributes may comprise an average execution duration of the particular test, a last execution time of the particular test, and a last execution status of the particular test. The examples may further enable determining attribute scores associated with individual attributes of the set of attributes and obtaining user-defined weights associated with the individual attributes. The examples may further enable determining a test score associated with the particular test based on the attribute scores and the user-defined weights associated with the individual attributes. The set of tests may be sorted based on the test score associated with the particular test. The sorted set of tests may be executed.

First claim

1 . A method for application testing, the method comprising:
identifying a set of tests for testing an application; identifying a set of attributes associated with a particular test of the set of tests, the set of attributes comprising an average execution duration of the particular test, a last execution time of the particular test, and a last execution status of the particular test; determining attribute scores associated with individual attributes of the set of attributes; obtaining user-defined weights associated with the individual attributes; determining a test score associated with the particular test based on the attribute scores and the user-defined weights associated with the individual attributes; sorting the set of tests based on the test score associated with the particular test; and causing the sorted set of tests to be executed.

2 . The method of claim 1 , further comprising:
identifying average execution durations of individual tests of the set of tests; determining a minimum average execution duration amongst the average execution durations of the individual tests; determining a maximum average execution duration amongst the average execution durations of the individual tests; and determining a first attribute score of the attribute scores based on the minimum average execution duration and the maximum average execution duration.

3 . The method of claim 1 , further comprising:
identifying last execution times of individual tests of the set of tests, the last execution time of the particular test comprising a difference in time between a current time and a time that the particular test was executed the last time on the application; determining a minimum last execution time amongst the last execution times of the individual tests; determining a maximum last execution time amongst the last execution times of the Individual tests; and determining a second attribute score of the attribute scores based on the minimum last execution time and the maximum last execution time.

4 . The method of claim 1 , wherein the last execution status of the particular test indicates whether the particular test was successfully executed on the application the last time, further comprising:
determining a third attribute score of the attribute scores based on the last execution status.

5 . The method of claim 2 , further comprising:
obtaining a first user-defined weight associated with the average execution duration of the particular test; and determining the test score associated with the particular test, the test score including the first attribute score scaled by the first user-defined weight.

6 . The method of claim 1 , further comprising:
identifying a time constraint for a particular job in a continuous integration (CI) pipeline or a continuous deployment (CD) pipeline, the particular job associated with a job policy that defines a subset of tests in the set of tests that are assigned to the particular job.

7 . The method of claim 6 , further comprising:
sorting the subset of tests in descending order of test scores associated with individual tests of the subset of tests; causing a first test of the sorted subset of tests to be executed, the first test having the highest test score among the test scores associated with the individual tests of the subset of tests; determining whether an execution duration of the first test is below the time constraint; and in response to determining that the execution duration of the first test is below the time constraint, causing a second test of the sorted subset of tests to be executed, the second test having the second highest test score among the test scores associated with the individual tests of the subset of tests.

8 . A non-transitory machine-readable storage medium comprising instructions executable by a processor of a computing device for application testing, the machine-readable storage medium comprising:
instructions to identify a set of tests for testing an application in a continuous integration (CI) pipeline or a continuous deployment (CD) pipeline, the CI or CD pipeline comprising a current testing job to which a first subset of the set of tests is assigned; instructions to identify a first set of attributes associated with a first test of the first subset, the first set of attributes comprising at least one of: an average execution duration of the first test, a last execution time of the first test, and a last execution status of the first test; instructions to identify a second set of attributes associated with a second test of the first subset, the second set of attributes comprising at least one of: an average execution duration of the second test, a last execution time of the second test, and a last execution status of the second test; instructions to determine a first test score associated with the first test based on the first set of attributes; instructions to determine a second test score associated with the second test based on the second set of attributes, wherein the first test score is higher than the second test score; and instructions to cause the first test to be executed during the current testing job before the second test is executed.

9 . The non-transitory machine-readable storage medium of claim 8 , further comprising:
instructions to obtain a time constraint for the current testing job; instructions to determine whether an execution duration of the first test exceeds the time constraint; and in response to determining that the execution duration of the first test exceeds the time constraint, instructions to prevent the second test from being executed.

10 . The non-transitory machine-readable storage medium of claim 9 ,
wherein the CI or CD pipeline comprises a next testing job to be executed after the current test job, the next testing job to which a second subset of the set of tests is assigned, further comprising: in response to determining that the execution duration of the first test exceeds the time constraint, instructions to cause at least one test of the second subset to be executed.

11 . The non-transitory machine-readable storage medium of claim 8 , further comprising:
instructions to determine a first attribute score associated with a first attribute of the first set of attributes; instructions to obtain a first user-defined weight associated with the first attribute; and instructions to determine the first test score based on the first attribute score scaled by the first user-defined weight;

12 . The non-transitory machine-readable storage medium of claim 11 , further comprising:
instructions to determine a second attribute score associated with the first attribute of the second set of attributes; instructions to determine the second test score based on the second attribute score scaled by the first user-defined weight; and instructions to sort the first test and the second test by comparing the first test score with the second test score.

13 . A system for application testing comprising:
a processor that: identifies a set of tests for testing an application in a continuous integration (CI) pipeline or a continuous deployment (CD) pipeline, the CI or CD pipeline comprising a particular testing job to which a first test and a second test of the set of tests are assigned; obtains a time constraint for the particular testing job; identifies a set of attributes associated with each of the first and second tests, the set of attributes comprising at least one of: an average execution duration, a last execution time, and a last execution status; determines a first test score associated with the first test b

Assignees

• David Peer
• Clement Arnaud Gaston Claude
• Chen Fan
• Eyal Fingold
• Entit Software Llc

Inventors

• Peer David
• Clement Arnaud Gaston Claude
• Chen Fan
• Fingold Eyal

Classifications

• G06F16/24578

  using ranking · CPC title

• G06F11/3688 Primary

  for test execution, e.g. scheduling of test suites · CPC title

• G06F9/44

  Arrangements for executing specific programs · CPC title

• G06F11/3684

  for test design, e.g. generating new test cases · CPC title

• G06F17/3053

  Physics · mapped topic