Generating workloads for system verification

Patent metadata

Field	Value
Publication number	US-11907108-B2
Application number	US-202217568966-A
Country	US
Kind code	B2
Filing date	Jan 5, 2022
Priority date	Jan 5, 2022
Publication date	Feb 20, 2024
Grant date	Feb 20, 2024

Abstract

A workload is generated to verify a system. The generating includes parsing one or more statements of an input test case to create one or more parsed structures. A comparison is performed of at least one parsed structure of the one or more parsed structures and at least one workload structure of at least one existing workload to identify one or more workload structures as matching the at least one parsed structure. Runtime data relating to at least the one or more workload structures identified as matching is obtained. The workload is created based on at least one matching workload structure of the one or more workload structures identified as matching, the at least one parsed structure of the one or more parsed structures and the runtime data.

First claim

What is claimed is:

1. A computer program product for facilitating processing within a computing environment, the computer program product comprising:
at least one non-transitory computer readable storage medium and program instructions collectively stored on the at least one computer readable storage medium to perform a method comprising:
testing a database system of the computing environment, the testing incorporating database system runtime data to enhance accuracy of the testing, the testing comprising:
dynamically generating, by a testing engine running in the computing environment, a test workload to be executed to test the database system of the computing environment, the test workload being dynamically generated based, at least, on one or more runtime conditions of the database system, the dynamically generating the test workload comprising:
parsing, by a statement parser of the testing engine, one or more database statements of an input test case to generate one or more parsed structures;
performing, by a comparator engine of the testing engine, based on generation of the one or more parsed statement structures, a comparison of at least one parsed structure of the one or more parsed structures and at least one test workload structure of at least one existing workload to identify one or more workload structures as matching the at least one parsed structure;
running the database system and collecting, using a runtime engine of the testing engine, database system runtime data relating to running at least the one or more workload structures identified as matching the at least one parsed structure;
based on the database system runtime data and one or more new database statements of one or more candidate test workloads, automatically generating at least one combined workload structure comprising one or more statement structures representing the one or more new database statements of the one or more candidate test workloads, and at least a portion of the database system runtime data, the at least a portion of the database system runtime data representing a requested alteration to a statement structure of the one or more statement structures;
generating a plurality of workloads based, at least, on the at least one combined workload structure with the at least a portion of the database system runtime data;
generating the test workload based on the plurality of workloads, wherein generating the test workload includes binding, based on the database system runtime data, the plurality of workloads to generate the test workload to be used to test the database system, wherein use of the database system runtime data enhances accuracy of the database system testing; and

executing the test workload to test the database system.

2. The computer program product of claim 1 , wherein the one or more parsed structures include at least one object dependency tree, one or more attributes and a syntax parse forest.

3. The computer program product of claim 1 , wherein the performing the comparison comprises performing an approximate match comparison.

4. The computer program product of claim 1 , wherein the testing further comprises generating the one or more candidate test workloads, based on the one or more workload structures identified as matching the at least one parsed structure, the one or more candidate workloads comprising the one or more new database statements.

5. The computer program product of claim 4 , wherein generating the one or more candidate test workloads is based on one or more object dependencies of the one or more parsed structures and one or more predefined rules.

6. A computer system for facilitating processing within a computing environment, the computer system comprising:
a memory; and
at least one processor in communication with the memory, wherein the computer system is configured to perform a method, said method comprising:
testing a database system of the computing environment, the testing incorporating database system runtime data to enhance accuracy of the testing, the testing comprising:
dynamically generating, by a testing engine running in the computing environment, a test workload to be executed to test the database system of the computing environment, the test workload being dynamically generated based, at least, on one or more runtime conditions of the database system, the dynamically generating the test workload comprising:
parsing, by a statement parser of the testing engine, one or more database statements of an input test case to generate one or more parsed structures;
performing, by a comparator engine of the testing engine, based on generation of the one or more parsed statement structures, a comparison of at least one parsed structure of the one or more parsed structures and at least one test workload structure of at least one existing workload to identify one or more workload structures as matching the at least one parsed structure;
running the database system and collecting, using a runtime engine of the testing engine, database system runtime data relating to running at least the one or more workload structures identified as matching the at least one parsed structure;
based on the database system runtime data and one or more new database statements of one or more candidate test workloads, automatically generating at least one combined workload structure comprising one or more statement structures representing the one or more new database statements of the one or more candidate test workloads, and at least a portion of the database system runtime data, the at least a portion of the database system runtime data representing a requested alteration to a statement structure of the one or more statement structures;
generating a plurality of workloads based, at least, on the at least one combined workload structure with the at least a portion of the database system runtime data;
generating the test workload based on the plurality of workloads, wherein generating the test workload includes binding, based on the database system runtime data, the plurality of workloads to generate the test workload to be used to test the database system, wherein use of the database system runtime data enhances accuracy of the database system testing; and

executing the test workload to test the database system.

7. The computer system of claim 6 , wherein the one or more parsed structures include at least one object dependency tree, one or more attributes and a syntax parse forest.

8. The computer system of claim 6 , wherein the performing the comparison comprises performing an approximate match comparison.

9. The computer system of claim 6 , wherein the testing further comprises generating the one or more candidate test workloads, based on the one or more workload structures identified as matching the at least one parsed structure, the one or more candidate workloads comprising the one or more new database statements.

10. The computer system of claim 9 , wherein generating the one or more candidate test workloads is based on one or more object dependencies of the one or more parsed structures and one or more predefined rules.

11. A computer-implemented method of facilitating processing within a computing environment, the computer-implemented method comprising:
testing a database system of the computing environment, the testing incorporating database system runtime data to enhance accuracy of the testing, the testing comprising:
dynamically generating, by a testing engine running in the computing environment, a test workload to be executed to test the database system of the computing environment, the test workload being dynamically generated based, at least, on one or more runtime

Assignees

• IBM

Inventors

• Cong Xue Bin
• Meng Xiao Feng
• Liang Ping
• He Yu
• Jiang peng hui

Classifications

• G06F11/3684 Primary

  for test design, e.g. generating new test cases · CPC title

• G06F11/3688

  for test execution, e.g. scheduling of test suites · CPC title