Generating and aggregating test result data of a distributed system of devices into a test case result for facilitating access of the test case result via a single iterator

Patent metadata

Field	Value
Publication number	US-11243872-B2
Application number	US-202016917516-A
Country	US
Kind code	B2
Filing date	Jun 30, 2020
Priority date	Jun 30, 2020
Publication date	Feb 8, 2022
Grant date	Feb 8, 2022

Abstract

Generating and aggregating test result data of a distributed system of devices into a test case result for facilitating access of the test case result via a single iterator is presented herein. A coordinator component of the distributed system of devices creates respective context identifiers for each unique phase of a test case of the distributed system of devices, and sends messages including the respective context identifiers to a producer component of the distributed system of devices. In this regard, the producer component includes producers having respective services executing processes corresponding to an execution of the test case. The messages instruct the respective services to associate the respective context identifiers with events representing result data of the processes, and the respective context identifiers facilitate respective accesses of the events representing the result data of the processes.

First claim

What is claimed is:

1. A system, comprising:
a processor; and
a memory that stores executable components that, when executed by the processor, facilitate performance of operations by the system, the operations comprising:
creating respective context identifiers for each unique phase of a test case of the system; and
sending messages comprising the respective context identifiers to respective services comprising processes corresponding to an execution of the test case, wherein the messages instruct the respective services to associate the respective context identifiers with events representing result data of the processes, and wherein the respective context identifiers facilitate respective accesses of the events representing the result data of the processes.

2. The system of claim 1 , wherein the unique phase of the test case comprises at least one of a set up phase or a tear down phase.

3. The system of claim 1 , wherein the operations further comprise:
nesting context identifiers to obtain nested context identifiers representing respective subtests of the unique phase of the test case to facilitate respective accesses of respective groups of events of the events comprising respective portions of the result data for the respective subtests of the unique phase of the test case.

4. The system of claim 1 , wherein the operations further comprise:
assigning defined event types to the events, wherein a defined event type of the defined event types comprises a metadata record comprising a context identifier (ID) of the respective context identifiers corresponding to a portion of the result data, a timestamp representing when a unit of the portion of the result data has been produced via a process of the processes, and information representing the unit of the portion of the result data.

5. The system of claim 4 , wherein the information representing the unit comprises text representing whether the test case has passed or failed.

6. The system of claim 4 , wherein the unit comprises unstructured data that has been generated via a failure corresponding to at least one of the system, the service, or the process.

7. The system of claim 6 , wherein the information representing the unit comprises a uniform resource indicator referencing the unstructured data.

8. The system of claim 6 , wherein the unstructured data comprises a core dump.

9. The system of claim 4 , wherein the operations further comprise:
based on the unit of the portion of the result data, generating a modified unit of result data.

10. The system of claim 9 , wherein the operations further comprise:
displaying, using hypertext markup language via a display device of the system, the modified result data.

11. The system of claim 9 , wherein the modified result data comprises a javascript object notation encoded array of dictionaries or extensible markup language.

12. The system of claim 4 , wherein the operations further comprise:
aggregating, in chronological order, a group of events of the events comprising the context ID into an aggregated event stream representing portions of the result data corresponding to the unique phase of the test case.

13. A method, comprising:
assigning, by a system comprising a processor, respective contextual information comprising respective global test identifications to distinct test phases of a test run;
initiating, by the system, an execution of the distinct test phases across a group of devices of the system; and
in response to initiating the execution of the distinct test phases across the group of devices, generating, by the system based on the respective contextual information via the group of devices, a group of events representing test results of the test run to facilitate, using the respective global test identifications, respective accesses of the group of events representing the test results of the test run.

14. The method of claim 13 , wherein initiating the execution of the distinct test phases comprises:
based on respective application programming interface calls that comprise the respective contextual information and that initiate execution of the distinct test phases, performing, by the system based on the respective contextual information, the execution of the distinct test phases across the group of devices.

15. The method of claim 13 , wherein generating the events comprises:
based on the respective context information, assigning respective event types to the events, wherein an event type of the respective event types that has been assigned to an event of the events corresponding to a test case of the distinct test phases comprises a global test identification of the respective global test identifications, a timestamp representing when a unit of the test results corresponding to the test case has been produced, and information representing the unit of the test results.

16. The method of claim 15 , further comprising:
generating, by the system based on the unit, a modified unit of test results.

17. The method of claim 13 , further comprising:
displaying, by the system via a display device, at least one of:
a core dump corresponding to test results,
a system log corresponding to the test results, or
text corresponding to the test results.

18. The method of claim 13 , further comprising:
selecting, by the system, events of the group of events comprising a global test identification of the global test identifications corresponding to a test case of the distinct test phases of the test run;
sorting, by the system, the events in chronological order to obtain an ordered stream of events of the test case; and
storing, by the system, the stream of events in a storage device of the system to facilitate, based on the global test identification, a display of the ordered stream of events of the test case.

19. A non-transitory machine-readable medium comprising instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:
assigning respective context identifiers to respective phases of a test case of the system;
sending messages comprising the respective context identifiers to respective services corresponding to processes for execution of the test case, wherein the messages direct the respective services to associate the respective context identifiers with events representing result data of the processes, and wherein the respective context identifiers facilitate respective accesses of the events representing the result data of the processes; and
storing the events in a storage device of the system to facilitate, using the respective context identifiers, the respective accesses of the events.

20. The non-transitory machine-readable medium of claim 19 , wherein the operations further comprise:
in response to selecting, from the events, a group of events comprising a context identifier of the respective context identifiers that has been assigned to a phase of the respective phases of the test case, generating an event stream comprising the group of events to facilitate a display of the event stream via a display device of the system.

Assignees

• Emc Ip Holding Co Llc

Inventors

• Bryan Matthew
• Van Voorhis Ii Henry Courtlandt

Classifications

• G06F11/3698

  Environments for analysis, debugging or testing of software · CPC title

• G06F11/3692

  for test results analysis · CPC title

• G06F11/0778

  Dumping, i.e. gathering error/state information after a fault for later diagnosis · CPC title

• G06F11/3495

  for systems · CPC title

• G06F2201/86

  Event-based monitoring · CPC title