Generating test plans for testing computer products based on product usage data

Patent metadata

Field	Value
Publication number	US-11256608-B2
Application number	US-201916532861-A
Country	US
Kind code	B2
Filing date	Aug 6, 2019
Priority date	Aug 6, 2019
Publication date	Feb 22, 2022
Grant date	Feb 22, 2022

Abstract

Implementations for generating test plans for testing computer products based on product usage data are described. An example method may include obtaining, by a processing device, data associated with usage of a computer product, identifying, from the obtained data, a first set of parameters relevant to testing the computer product and a first set of values corresponding to the first set of parameters, comparing, by the processing device, the first set of parameters and the first set of values to a second set of parameters and a second set of values associated with a test plan to test the computer product, and generating, by the processing device, a modified version of the test plan in view of the comparison.

First claim

What is claimed is:

1. A method comprising:
obtaining, by a processing device associated with a quality assurance system, a plurality of data records associated with customer specific usage of a computer product external to the quality assurance system, wherein the plurality of data records comprises a first data record having a first data format and a second data record having a second data format different from the first data format;
converting, by the processing device, the plurality of data records into a set of data having a unified data format representing the customer specific usage of the computer product;
receiving, by the processing device, a request to filter the set of data in view of an item;
in response to receiving the request, obtaining, by the processing device from the set of data, a set of relevant data relevant to testing the computer product by identifying a first set of parameters relevant to testing the computer product based on a mapping between parameters of the set of data and the item, and a first set of values corresponding to the first set of parameters;
comparing, by the processing device, the first set of parameters and the first set of values to a second set of parameters and a second set of values associated with a test plan to test the computer product, thereby identifying a set of differences; and
generating, by the processing device, a modified version of the test plan by modifying the second set of parameters and the second set of values based on the set of differences.

2. The method of claim 1 , wherein the test plan comprises one or more test cases, each of the one or more test cases comprising a set of actions to be performed involving the computer product.

3. The method of claim 2 , wherein the set of actions comprises an action performed using one or more of:
the first set of parameters and the first set of values, or
the second set of parameters and the second set of values.

4. The method of claim 1 , wherein the data associated with customer specific usage of the computer product comprises one or more of product configuration data, infrastructure resource data, user interface data, or product feature data.

5. The method of claim 1 , wherein receiving the request comprises receiving, by the processing device, a user selection of the item from a user interface.

6. The method of claim 1 , wherein identifying the first set of values comprises:
identifying the first set of values from the data satisfying a threshold criterion for each parameter of the first set of parameters without any user interactions.

7. The method of claim 6 , wherein the threshold criterion for each parameter of the first set of parameters is configurable.

8. The method of claim 1 , wherein generating the modified version of the test plan comprises one or more of:
adding a first set of test cases to the test plan;
removing a second set of test cases from the test plan; or
updating of a third set of test cases in the test plan.

9. The method of claim 1 , further comprising:
providing, by the processing device, one or more configuration files with the modified version of test plan to test the computer product using the one or more configuration files.

10. The method of claim 1 , further comprising:
providing, by the processing device, a computing environment according to one or more of the first set of parameters and the first set of values to test the computer product using the modified version of the test plan.

11. The method of claim 1 , further comprising:
creating a set of automation jobs to execute the modified version of the test plan.

12. The method of claim 11 , wherein the set of automation jobs comprises a set of instructions to execute a set of actions without user interaction, the set of actions automating testing steps identified in the test plan.

13. A system comprising:
a memory; and
a processing device associated with a quality assurance system, the processing device communicably coupled to the memory to:
obtain a set of data having a unified data format representing customer specific usage of a computer product external to the quality assurance system;
receive a request to filter the set of data in view of an item;
in response to receiving the request, obtain, from the set of data, a set of relevant data relevant to testing the computer product by identifying a first set of parameters relevant to testing the computer product based on a mapping between parameters of the set of data and the item, and a first set of values corresponding to the first set of parameters;
identify a set of differences between the first set of parameters and the first set of value and a second set of parameters and a second set of values, respectively;
build a test plan to test the computer product based on the set of differences;
create a set of automation jobs to execute the test plan;
generate a computing environment according to one or more of the first set of parameters and the first set of values; and
provide instructions to execute at least a portion of the test plan using the set of automation jobs in the computing environment.

14. The system of claim 13 , wherein the set of automation jobs comprises a set of instructions to execute a set of actions without user interaction, the set of actions automating testing steps identified in the test plan.

15. The system of claim 13 , wherein to receive the request, the processing device is to receive a user selection of the item from a user interface.

16. The system of claim 13 , wherein to build the test plan, the processing device is to:
add one or more test cases to the test plan, each of the one or more test cases comprising a set of actions to be executed involving the computer product.

17. A non-transitory machine-readable storage medium storing instructions that cause a processing device associated with a quality assurance system to:
obtain a plurality of data records associated with customer specific usage of a computer product external to the quality assurance system, wherein the plurality of data records comprises a first data record having a first data format and a second data record having a second data format different from the first data format;
convert the plurality of data records into a set of data having a unified data format representing the customer specific usage of the computer product;
receive a request to filter the set of data in view of an item;
in response to receiving the request, identify, from the set of data, a set of relevant data relevant to testing the computer product by identifying a first set of parameters relevant to testing the computer product based on a mapping between parameters of the set of data and the item, and a first set of values corresponding to the first set of parameters;
compare the first set of parameters and the first set of values with a second set of parameters and a second set of values associated with a test plan to test the computer product, thereby identifying a set of differences; and
generate a modified version of the test plan by modifying the second set of parameters and the second set of values based on the set of differences.

18. The non-transitory machine-readable storage medium of claim 17 , wherein to generate the modified version of the test plan, the processing device is to perform one or more of:
addition of a first set of test cases to the test plan;
removal of a second set of test cases from the test plan; or
update of a third set of test cases existing in the test plan.

Assignees

• Red Hat Inc

Inventors

• Kuris Eran
• Bregman Arie

Classifications

• H04L67/10

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title

• G06F11/3438 Primary

  monitoring of user actions (tracking the activity of the user H04L67/535) · CPC title

• G06F11/3684 Primary

  for test design, e.g. generating new test cases · CPC title

• G06F11/368

  for test version control, e.g. updating test cases to a new software version · CPC title

• G06F16/258

  Data format conversion from or to a database · CPC title