Configurable testing of computer programs

Patent metadata

Field	Value
Publication number	US-9274926-B2
Application number	US-201414165698-A
Country	US
Kind code	B2
Filing date	Jan 28, 2014
Priority date	Jan 3, 2013
Publication date	Mar 1, 2016
Grant date	Mar 1, 2016

Abstract

Configurable testing of a computer program includes: storing a set of one or more testing specifications, and attribute information defining one or more attributes of a recognizable portion of the computer program; and processing, using at least one processor, the computer program according to at least a first testing specification associated with the computer program. The processing includes: traversing a representation of the computer program that includes elements that represent recognizable portions of the computer program, and while traversing the representation, recognizing recognizable portions of the computer program, and storing values of attributes, defined by the attribute information, of the recognized portions of the computer program.

First claim

What is claimed is:

1. A computing system for configurable testing of a computer program, the computing system including:
a storage medium storing a set of one or more testing specifications, and attribute information defining one or more attributes of a recognizable portion of the computer program; and
a configurable testing module, including at least one processor, configured to process the computer program according to at least a first testing specification associated with the computer program, the first testing specification including at least a first test that applies to multiple portions of the computer program, the processing including:
traversing a representation of the computer program that includes elements that represent recognizable portions of the computer program,
while traversing the representation, recognizing recognizable portions of the computer program,
while traversing the representation, for at least a first recognized portion of the computer program, storing one or more values of one or more attributes of the first recognized portion of the computer program, wherein each attribute whose value is stored while traversing the representation is defined by the attribute information as being an attribute of one or more of the recognizable portions of the computer program,
performing any aggregation functions specified in the first testing specification based at least in part on stored values of attributes of one or more recognized portions of the computer program, and
performing the first test specified in the first testing specification based at least in part on stored results of any aggregation functions performed while traversing the representation.

2. The system of claim 1 , wherein the processing further includes: performing at least one test specified in at least the first testing specification based at least in part on stored values of attributes of one or more recognized portions of the computer program.

3. The system of claim 2 , wherein the first testing specification includes a test that tests at least one characteristic of the computer program that does not represent an error that would prevent the computer program from executing.

4. The system of claim 2 , wherein the first testing specification includes a test that tests at least one characteristic of the computer program associated with code reuse efficiency.

5. The system of claim 2 , wherein the first testing specification includes a test that tests at least one characteristic of the computer program associated with memory use constraints.

6. The system of claim 5 , wherein the characteristic of the computer program associated with memory use constraints includes a maximum amount of main memory that a particular recognized portion of the computer program is allowed to use when the computer program executes.

7. The system of claim 2 , wherein the first testing specification includes a test that tests a number of times at least one particular operation is used in the computer program.

8. The system of claim 2 , wherein the first testing specification includes a test that references a value of a name attribute of a recognizable portion of the computer program to determine whether to continue applying the test.

9. The system of claim 2 , the processing further including presenting in a user interface a result of at least one test, the result being visually associated with a displayed portion of the computer program on which the test was performed.

10. The system of claim 1 , wherein the storage medium stores activation information indicating which of the testing specifications are active.

11. The system of claim 10 , wherein at least one of the testing specifications includes at least one local test that applies to a particular portion of the computer program, and at least one of the testing specifications includes at least one global test that applies to multiple portions of the computer program.

12. The system of claim 11 , wherein the processing further includes: accessing the activation information to determine one or more testing specifications that are indicated as active.

13. The system of claim 12 , wherein the set of one or more testing specifications is a hierarchical set that relates at least some of the testing specifications to each other according to a hierarchy.

14. The system of claim 13 , wherein accessing the activation information to determine one or more testing specifications that are indicated as active includes identifying active testing specifications along a path up the hierarchy between the first testing specification and a root of the hierarchy.

15. The system of claim 12 , wherein the processing further includes: while traversing the representation, performing any local tests specified in any active testing specifications based at least in part on stored values of attributes of one or more recognized portions of the computer program.

16. The system of claim 12 , wherein the processing further includes: while traversing the representation, performing any aggregation functions specified in any active testing specifications based at least in part on stored values of attributes of one or more recognized portions of the computer program.

17. The system of claim 16 , wherein the processing further includes: after traversing the representation, performing any global tests specified in any active testing specifications based at least in part on stored results of any aggregation functions performed while traversing the representation.

18. The system of claim 1 , wherein the representation of the computer program is a graph based-representation and the elements include: nodes that represent at least some of the recognizable portions, and links that represent relationships between the recognizable portions represented by the nodes.

19. The system of claim 18 , wherein the graph-based representation includes a dataflow graph that includes: processing components represented by the nodes, and flows of data between processing components represented by the links.

20. The system of claim 19 , wherein at least some of the recognizable portions include a flow of data between processing components.

21. The system of claim 19 , wherein at least some of the recognizable portions include an input or output port of a processing component.

22. The system of claim 19 , wherein at least some of the recognizable portions include a parameter associated with a processing component or a flow of data between processing components.

23. The system of claim 18 , wherein the graph-based representation includes a control flow graph that includes: basic blocks of code represented by the nodes, and changes of control between basic blocks represented by the links.

24. The system of claim 1 , the testing further including receiving user input for specifying at least one testing specification of the set of one or more testing specifications.

25. The system of claim 24 , wherein at least some of the attribute information is predetermined before at least some of the user input is received.

26. A computing system for configurable testing of a computer program, the computing system including:
means for storing a set of one or more testing specifications, and attribute information defining one or more attributes of a recognizable portion of the computer program; and
means for processing the computer program according to at least a first testi

Assignees

• Ab Initio Technology Llc

Inventors

• Larson Brond
• Offner Carl
• Wholey Iii Joseph Skeffington

Classifications

• G06F11/368 Primary

  for test version control, e.g. updating test cases to a new software version · CPC title

• G06F11/3688

  for test execution, e.g. scheduling of test suites · CPC title

• G06F11/3604 Primary

  Analysis of software for verifying properties of programs (testing of software G06F11/3668) · CPC title