Product test orchestration

Patent metadata

Field	Value
Publication number	US-10672013-B2
Application number	US-201615248286-A
Country	US
Kind code	B2
Filing date	Aug 26, 2016
Priority date	Jul 14, 2016
Publication date	Jun 2, 2020
Grant date	Jun 2, 2020

Abstract

According to an example, product test orchestration may include accessing user-defined information of a product to be tested and identifying, based upon the accessed user-defined information, a set of devices on which the product is to be tested and a set of testing tools to be implemented on the identified set of devices to test the product. Product test orchestration may further include generating test operations for the identified set of testing tools to be implemented on the identified set of devices, executing the generated test operations on the identified set of devices, tracking results of the executed test operations, and generating a report of the tracked results.

First claim

What is claimed is:

1. A product test orchestration apparatus comprising:
a processor; and
a non-transitory computer readable medium on which is stored instructions that when executed by the processor cause the processor to:
access user-defined information of a product to be tested, wherein the accessed user-defined information includes one or more user-specified key performance indicators each having a given weighted value;
identify a set of devices on which the product is to be tested based upon the accessed user-defined information;
identify a user-defined element related to the identified set of devices to test concurrently with the identified set of devices;
identify, using at least one of the identified set of devices and the user-defined element, a minimum number of devices on which the product is to be tested;
identify a set of testing tools to be implemented on the identified minimum number of devices to test the product based upon the one or more user-specified key performance indicators;
generate test operations for the identified set of testing tools to be implemented on the identified minimum number of devices, wherein the instructions are further executable to:
generate a series of questions to list the identified set of devices to test and the identified set of testing tools to be implemented; and
receive a user-defined input parameter provided in response to the generated series of questions;

execute the generated test operations on the identified minimum number of devices utilizing the user-defined input parameter, wherein the instructions are further executable to:
present a test step model via a user interface;
receive a selection of user-specified required steps via the user interface;
apply an adapter customization during execution of the generated test operation; and
design a test scenario utilizing the test step model and the user-specified required steps, including utilizing a customized adapter to execute test automation scripts during execution of the designed test scenario;

track results of the executed test operations; and
generate a report of the tracked results.

2. The product test orchestration apparatus according to claim 1 , wherein to access the user-defined information, the instructions are further to cause the processor to:
request for information via the user interface to obtain the user-defined information, wherein the processor is to identify the set of devices and the set of testing tools based upon responses to the request for information.

3. The product test orchestration apparatus according to claim 1 , wherein to identify the set of devices, the instructions are further to cause the processor to:
calculate market coverage of a group of devices that matches criteria in the user-defined information; and
identify the set of devices from the group of devices, wherein the identified set of devices comprises devices in the group of devices including relatively high market coverage.

4. The product test orchestration apparatus according to claim 1 , wherein to identify the set of devices, the instructions are further to cause the processor to:
identify a group of devices that matches criteria in the user-defined information;
determine, for each device in the identified group of devices, data pertaining to the device, wherein the data comprises at least one of market share, popularity based on region, country in which the product is to be used, product type, and connectivity type for the product; and
identify the set of devices from the group of devices based upon the data.

5. The product test orchestration apparatus according to claim 1 , wherein to identify the set of testing tools, the instructions are further to cause the processor to:
identify the set of testing tools from a database on which is stored information on a group of previously evaluated testing tools.

6. The product test orchestration apparatus according to claim 1 , wherein the instructions are further to cause the processor to:
write the test automation scripts to generate the test operations; and
execute the written test automation scripts to execute the generated test operations.

7. The product test orchestration apparatus according to claim 1 , wherein the instructions are further to cause the processor to:
generate a system model; and
generate the test operations using the generated system model.

8. The product test orchestration apparatus according to claim 1 , further comprising:
a robotic manipulator,
wherein the instructions are further to cause the processor to:
control the robotic manipulator to interact with at least one device of the identified minimum number of devices according to a generated test operation to execute the generated test operations.

9. The product test orchestration apparatus according to claim 1 , wherein the generated test operations are to simulate actions that the product is to perform on the identified minimum number of devices.

10. The product test orchestration apparatus according to claim 1 , wherein the set of devices comprises at least one of a mobile device, a user-wearable device, a laptop computer, and a server computer.

11. The product test orchestration apparatus according to claim 1 , wherein the user-defined information further includes information pertaining to an industry in which the product is to be employed, and wherein the processor is to identify the set of devices and the set of testing tools that correspond to an ecosystem of the industry in which the product is to be employed.

12. A computer-implemented method for orchestrating a product test, the method comprising:
accessing, by a processor, information regarding a computer-implemented product to be tested, wherein the accessed information includes one or more user-specified key performance indicators each having a given weighted value;
identifying, by the processor and based upon the accessed information, a set of devices on which the computer-implemented product is to be tested;
identifying a user-defined element related to the identified set of devices to test concurrently with the identified set of devices;
identifying, using at least one of the identified set of devices and the user-defined element, a minimum number of devices on which the computer-implemented product is to be tested;
identifying, by the processor, a set of testing tools to be implemented on the identified minimum number of devices to test the computer-implemented product based upon the one or more user-specified key performance indicators;
generating, by the processor, test operations for the identified set of testing tools to be implemented on the identified minimum number of devices, further including:
generating a series of questions to list the identified set of devices to test and the identified set of testing tools to be implemented; and
receiving a user-defined input parameter provided in response to the generated series of questions; and

executing, by the processor, the generated test operations on the identified minimum number of devices utilizing the user-defined input parameter, further including:
presenting a test step model via a user interface;
receiving a selection of user-specified required steps via the user interface; and
applying an adapter customization during execution of the generated test operations;
designing a test scenario utilizing the test step model and the user-specified required steps, including utilizing a customized adapter to execute test automation scripts during execution of the designed test scenario.

13. The method according to claim 12 , further comprising:
tracking

Assignees

• Accenture Global Solutions Ltd

Inventors

• BS Vijaya Krishna
• Gogula Sunilkumar
• Muthusamy Ashok K
• KAPALI Sadanand

Classifications

• G06F11/3664

  Physics · mapped topic

• G06Q30/0201 Primary

  Market modelling; Market analysis; Collecting market data · CPC title

• G06F11/368

  for test version control, e.g. updating test cases to a new software version · CPC title

• G06F11/3698 Primary

  Environments for analysis, debugging or testing of software · CPC title