Test case generation

Patent metadata

Field	Value
Publication number	US-10318667-B2
Application number	US-201514971300-A
Country	US
Kind code	B2
Filing date	Dec 16, 2015
Priority date	Dec 16, 2015
Publication date	Jun 11, 2019
Grant date	Jun 11, 2019

Abstract

Embodiments of the present invention provide methods, computer program products, and systems for generating comprehensive test cases covering new events yet to be covered. Embodiments of the present invention can be used to receive a request to generate a test case, wherein the request comprises a coverage schema associated with a first set of events to be covered in the generated test case. Embodiments of the present invention can update the coverage schema, wherein updating the coverage schema comprises adding a second set of events to be covered in the generated test case and generate constraints used to satisfy requirements for meeting the first and the second set of events in the updated coverage schema. Embodiments of the present invention can generate a test case using the generated constraints and the updated schema.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving a request to generate a test case, wherein the request comprises a coverage schema associated with a first set of events to be covered in the generated test case;
improving a design of the requested test case by generating a comprehensive test case and using results of the generated test case to build computing hardware that incorporates the results of the generated comprehensive test case, wherein improving a design of the request test case comprises:
updating the coverage schema, wherein updating the coverage schema comprises adding a second set of events to be covered in the generated test case;
generating constraints not specified by the received request to generate the test case or the received coverage schema, wherein the generated constraints are used to satisfy requirements for meeting the first and the second set of events in the updated coverage schema;
responsive to generating constraints use to satisfy requirements for meeting the first set of events and the second set of events in the updated coverage schema, adding the generated constraints to a constraint library;
generating a test case that covers new events yet to be covered and are not performed by a user using the generated constraints and the updated schema;
performing a test simulation to identify a passing test case;
updating a coverage database to reflect the identified passing test case and;
generating a report detailing results of the performed test simulation of the passing test case.

2. The computer-implemented method of claim 1 , wherein adding a second set of events to be covered in the generated test case comprises:
performing a union operation, an intersection operation, or a cross-product operation between at least two events of the first set of events.

3. The computer-implemented method of claim 2 , further comprising:
building a constraint library for the second set of events.

4. The computer-implemented method of claim 1 , wherein adding a second set of events to be covered in the generated test case comprises:
using machine learning techniques to determine the second set of events.

5. The computer-implemented method of claim 1 , further comprising:
responsive to a failure to generate constraints, transmitting a notification to a constraint library; and
using machine learning techniques to improve the constraint library.

6. A computer program product comprising:
one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising:
program instructions to receive a request to generate a test case, wherein the request comprises a coverage schema associated with a first set of events to be covered in the generated test case;
program instructions to improve a design of the requested test case by generating a comprehensive test case and using results of the generated test case to build computing hardware that incorporates the results of the generated comprehensive test case, wherein the program instructions to improve a design of the request test case comprise:
program instructions to update the coverage schema, wherein the program instructions to update the coverage schema comprise program instructions to add a second set of events to be covered in the generated test case;
program instructions to generate constraints not specified by the received request to generate the test case or the received coverage schema, wherein the generated constraints are used to satisfy requirements for meeting the first and the second set of events in the updated coverage schema;
program instructions to, responsive to generating constraints use to satisfy requirements for meeting the first set of events and the second set of events in the updated coverage schema, add the generated constraints to a constraint library;
program instructions to generate a test case that covers new events yet to be covered and are not performed by a user using the generated constraints and the updated schema;
program instructions to perform a test simulation to identify a passing test case;
program instructions to update a coverage database to reflect the identified passing test case and;
program instructions to generate a report detailing results of the performed test simulation of the passing test case.

7. The computer program product of claim 6 , wherein the program instructions to add a second set of events to be covered in the generated test case comprise:
program instructions to perform a union operation, an intersection operation, or a cross-product operation between at least two events of the first set of events.

8. The computer program product of claim 7 , wherein the program instructions stored on the one or more computer readable storage media further comprise:
program instructions to build a constraint library for the second set of events.

9. The computer program product of claim 6 , wherein the program instructions to add a second set of events to be covered in the generated test case comprise:
program instructions to use machine learning techniques to determine the second set of events.

10. The computer program product of claim 6 , wherein the program instructions stored on the one or more computer readable storage media further comprise:
program instructions to, responsive to a failure to generate constraints, transmit a notification to a constraint library; and
program instructions to use machine learning techniques to improve the constraint library.

11. A computer system comprising:
one or more computer processors;
one or more computer readable storage media; and
program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising:
program instructions to receive a request to generate a test case, wherein the request comprises a coverage schema associated with a first set of events to be covered in the generated test case;
program instructions to improve a design of the requested test case by generating a comprehensive test case and using results of the generated test case to build computing hardware that incorporates the results of the generated comprehensive test case, wherein the program instructions to improve a design of the request test case comprise:
program instructions to update the coverage schema, wherein the program instructions to update the coverage schema comprise program instructions to add a second set of events to be covered in the generated test case;
program instructions to generate constraints not specified by the received request to generate the test case or the received coverage schema, wherein the generated constraints are used to satisfy requirements for meeting the first and the second set of events in the updated coverage schema;
program instructions to, responsive to generating constraints use to satisfy requirements for meeting the first set of events and the second set of events in the updated coverage schema, add the generated constraints to a constraint library;
program instructions to generate a test case that covers new events yet to be covered and are not performed by a user using the generated constraints and the updated schema;
program instructions to perform a test simulation to identify a passing test case;
program instructions to update a coverage database to reflect the identified passing test case and;
program instructions to generate a report detailing results of the performed test simulation of the passing test case.

12. The computer sy

Assignees

• IBM

Inventors

• Dusanapudi Manoj
• Kadiyala Madhusudan
• Paul John

Classifications

• G06N5/01

  Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound · CPC title

• G06N20/00 Primary

  Machine learning · CPC title

• G06F16/23

  Updating · CPC title

• G06F11/3684

  for test design, e.g. generating new test cases · CPC title

• G06F11/263

  Generation of test inputs, e.g. test vectors, patterns or sequences {; with adaptation of the tested hardware for testability with external testers} · CPC title