Effective correlation of multiple time-series result sets

Patent metadata

Field	Value
Publication number	US-2020073866-A1
Application number	US-201916391604-A
Country	US
Kind code	A1
Filing date	Apr 23, 2019
Priority date	Sep 4, 2018
Publication date	Mar 5, 2020
Grant date	—

Abstract

The technology disclosed relates to a method for storing and time-correlating real-time and queryable test results of a test of a device under test (DUT). The method includes initiating the test applied to the DUT to collect real-time data from a multitude of data streams for multiple aspects of the DUT, the collected data including counters and fact-type values, the collected data having imperfectly synchronized time bases and the collected data being collected from different sources asynchronously at different times, specifying a recording time interval for recording the data collected among multiple databases, recording data according to the specified recording time interval, such that each piece of the recorded data is associated with a particular time interval, and at a conclusion of the test, correlating the recorded data with the test configuration data about a test state in the respective time intervals.

First claim

We claim as follows:

1 . A method of efficiently monitoring performance counters of a device under test (DUT) during a high data volume test having data event volumes that cannot be recorded at an event level, the method including:
specifying a time interval for recording counters on data planes and control planes; using the time interval during a test of the DUT to control persisting numerous counters on a multitude of data streams and to create numerous time series data of the counters, allowing recording of counters from different sources asynchronously at different times; at a conclusion of the test, correlating the numerous time series data from the recorded counters with test configuration data about a test state in the time intervals; and correlating data from external sources that also have imperfectly synchronized time bases.

2 . The method of claim 1 , wherein the asynchronously recorded counters are correlated according to the specified time interval, such that counters having different time stamps are correlated to a same interval.

3 . The method of claim 2 , wherein the test configuration data, having different time stamps, and the data from the external sources, having different time stamps, are correlated according to the specified time interval.

4 . A method of storing and time-correlating real-time and queryable test results of a test of a device under test (DUT), where the test of the DUT results in a multitude of data streams of multiple aspects of the DUT, the method comprising:
initiating the test applied to the DUT according to test configuration data to collect, among multiple databases, real-time data from the multitude of data streams for the multiple aspects of the DUT, the collected data including counters and fact-type values, the collected data having imperfectly synchronized time bases among the multiple databases and the collected data being collected from different sources asynchronously at different times; prior to applying the test to the DUT or during the application of the test on the DUT, specifying a user configurable recording time interval for recording the data collected among the multiple databases; recording the data collected among the multiple databases according to the specified recording time interval, such that each piece of the recorded data is associated with a particular time interval, having a duration of the specified recording time interval, in dependence upon time series information of the piece of data; at a conclusion of the test, correlating the recorded data with the test configuration data about a test state in the respective time intervals; and at the conclusion of the test or during the test performing a user defined query on the recorded data according to a user defined query time interval that is the same as or greater than the specified recording time interval.

5 . The method of claim 4 , wherein the recorded data collected among the multiple databases is recorded into a database that implements a star schema including a fact table and a dimension table.

6 . The method of claim 4 , wherein the time series information is timestamp information.

7 . The method of claim 6 , wherein the recorded data is treated as dimensional if timestamps are not available.

8 . The method of claim 4 , wherein, when multiple pieces of data exist within the user defined query time interval for a particular aspect of the DUT, the user defined query on the recorded data provides a result based on at least one of determining a sum of the multiple pieces of data, determining an average of the multiple pieces of data, identifying a maximum value of the multiple pieces of data and identifying a minimum value of the multiple pieces of data.

9 . The method of claim 4 , wherein the recorded data includes data-plane data and control-plane data.

10 . The method of claim 4 , further comprising providing, for display in a web user interface, results of the user defined query.

11 . The method of claim 4 , further comprising changing a value of the user configured recording interval from one value to another value during the test applied to the DUT.

12 . A non-transitory computer-readable recording medium having a program recorded thereon, the program for storing and time-correlating real-time and queryable test results of a test of a device under test (DUT), where the test of the DUT results in a multitude of data streams of multiple aspects of the DUT, and the program, when executed on a computer, causes a processor of the computer to perform a method comprising:
initiating the test applied to the DUT according to test configuration data to collect, among multiple databases, real-time data from the multitude of data streams for the multiple aspects of the DUT, the collected data including counters and fact-type values, the collected data having imperfectly synchronized time bases among the multiple databases and the collected data being collected from different sources asynchronously at different times; prior to applying the test to the DUT or during the application of the test on the DUT, specifying a user configurable recording time interval for recording the data collected among the multiple databases; recording the data collected among the multiple databases according to the specified recording time interval, such that each piece of the recorded data is associated with a particular time interval, having a duration of the specified recording time interval, in dependence upon time series information of the piece of data; at a conclusion of the test, correlating the recorded data with the test configuration data about a test state in the respective time intervals; and at the conclusion of the test or during the test performing a user defined query on the recorded data according to a user defined query time interval that is the same as or greater than the specified recording time interval.

13 . The non-transitory computer-readable recording medium of claim 12 , wherein the recorded data collected among the multiple databases is recorded into a database that implements a star schema including a fact table and a dimension table.

14 . The non-transitory computer-readable recording medium of claim 12 , wherein the time series information is timestamp information.

15 . The non-transitory computer-readable recording medium of claim 14 , wherein the recorded data is treated as dimensional if timestamps are not available.

16 . The non-transitory computer-readable recording medium of claim 12 , wherein, when multiple pieces of data exist within the user defined query time interval for a particular aspect of the DUT, the user defined query on the recorded data provides a result based on at least one of determining a sum of the multiple pieces of data, determining an average of the multiple pieces of data, identifying a maximum value of the multiple pieces of data and identifying a minimum value of the multiple pieces of data.

17 . The non-transitory computer-readable recording medium of claim 12 , wherein the recorded data includes data-plane data and control-plane data.

18 . The non-transitory computer-readable recording medium of claim 12 , wherein the method further comprises providing, for display in a web user interface, results of the user defined query.

19 . The non-transitory computer-readable recording medium of claim 12 , wherein the method further comprises changing a value of the user configured recording interval from one value to another value during the test applie

Assignees

• Spirent Communications Inc

Inventors

• Joyner David
• Patel Rahul

Classifications

• G06F16/283

  Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP · CPC title

• G06F16/2477 Primary

  Temporal data queries · CPC title

• G06F16/24561 Primary

  Intermediate data storage techniques for performance improvement · CPC title

• G06F16/212

  with details for data modelling support · CPC title

• G06F16/156

  Query results presentation · CPC title