Dynamic component performance monitoring

Patent metadata

Field	Value
Publication number	US-10452509-B2
Application number	US-201816137822-A
Country	US
Kind code	B2
Filing date	Sep 21, 2018
Priority date	Nov 16, 2012
Publication date	Oct 22, 2019
Grant date	Oct 22, 2019

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for dynamic graph performance monitoring. One of the methods includes receiving input data by the data processing system, the input data provided by an application executing on the data processing system. The method includes determining a characteristic of the input data. The method includes identifying, by the application, a dynamic component from multiple available dynamic components based on the determined characteristic, the multiple available dynamic components being stored in a data storage system. The method includes processing the input data using the identified dynamic component. The method also includes determining one or more performance metrics associated with the processing.

First claim

What is claimed is:

1. A method for processing data in a data processing system, the method including:
receiving input data records by a first program executing on the data processing system, with the first program having an output port that outputs, to a data store, one or more performance metrics indicative of a performance of a dynamic program loaded into the first program;
based on a characteristic of one or more input data records, identifying, by the first program executing on the data processing system, a dynamic program from multiple available dynamic programs stored in a data storage system;
loading the dynamic program identified from the data storage system into the first program;
processing, by at least the loaded dynamic program executing on the data processing system, the one or more input data records;
outputting, by the output port of the first program executing on the data processing system, one or more performance metrics indicative of performance of processing the one or more input data records with the dynamic program identified based on the characteristic of the one or more input data records and loaded from the data storage system into the first program;
writing the one or more performance metrics to the data store;
selecting, from among a plurality of performance metrics that are written to the data store and that are indicative of performances of at least a plurality of the multiple available dynamic programs, one or more performance metrics associated with an identifier of the identified dynamic program loaded into the first program and one or more other performance metrics associated with the identifier of the identified dynamic program loaded into the first program or into a second program; and
aggregating (i) the one or more performance metrics that are selected from the data store and that are indicative of performance of the processing of the one or more input data records with the dynamic program identified based on the characteristic of the one or more input data records and loaded from the data storage system into the first program, with (ii) the other one or more performance metrics that are selected from the data store and that are indicative of performance of processing one or more other input data records with the identified dynamic program that is loaded from the data storage system into the first program or into the second program.

2. The method of claim 1 , wherein further including storing aggregated performance metrics in an in-memory data store.

3. The method of claim 1 , further including transferring the output one or more performance metrics to a persistent data store.

4. The method of claim 1 , further including generating data for a graphical user interface that when rendered on a display device displays the one or more performance metrics output, the selected one or more performance metrics or the aggregated performance metrics.

5. A data processing system for processing data, including:
one or more processors; and
one or more machine-readable hardware storage devices configured to store instructions that are executable by the one or more processors to perform operations including:
receiving input data records by a first program executing on the data processing system, with the first program having an output port that outputs, to a data store, one or more performance metrics indicative of a performance of a dynamic program loaded into the first program;
based on a characteristic of one or more input data records, identifying, by the first program executing on the data processing system, a dynamic program from multiple available dynamic programs stored in a data storage system;
loading the dynamic program identified from the data storage system into the first program;
processing, by at least the loaded dynamic program executing on the data processing system, the one or more input data records;
outputting, by the output port of the first program executing on the data processing system, one or more performance metrics indicative of performance of processing the one or more input data records with the dynamic program identified based on the characteristic of the one or more input data records and loaded from the data storage system into the first program;
writing the one or more performance metrics to the data store;
selecting, from among a plurality of performance metrics that are written to the data store and that are indicative of performances of at least a plurality of the multiple available dynamic programs, one or more performance metrics associated with an identifier of the identified dynamic program loaded into the first program and one or more other performance metrics associated with the identifier of the identified dynamic program loaded into the first program or into a second program; and
aggregating (i) the one or more performance metrics that are selected from the data store and that are indicative of performance of the processing of the one or more input data records with the dynamic program identified based on the characteristic of the one or more input data records and loaded from the data storage system into the first program, with (ii) the other one or more performance metrics that are selected from the data store and that are indicative of performance of processing one or more other input data records with the identified dynamic program that is loaded from the data storage system into the first program or into the second program.

6. The data processing system of claim 5 , further including: an in-memory data store for storing aggregated performance metrics in the in-memory data store.

7. The data processing system of claim 5 , wherein the operations further include transferring the output one or more performance metrics to a persistent data store.

8. The data processing system of claim 5 , wherein the operations further include generating data for a graphical user interface that when rendered on a display device displays the one or more performance metrics output, the selected one or more performance metrics or the aggregated performance metrics.

9. One or more machine-readable hardware storage devices configured to store instructions that are executable by one or more processors to perform operations including:
receiving input data records by a first program executing on the data processing system, with the first program having an output port that outputs, to a data store, one or more performance metrics indicative of a performance of a dynamic program loaded into the first program;
based on a characteristic of one or more input data records, identifying, by the first program executing on the data processing system, a dynamic program from multiple available dynamic programs stored in a data storage system;
loading the dynamic program identified from the data storage system into the first program;
processing, by at least the loaded dynamic program executing on the data processing system, the one or more input data records;
outputting, by the output port of the first program executing on the data processing system, one or more performance metrics indicative of performance of processing the one or more input data records with the dynamic program identified based on the characteristic of the one or more input data records and loaded from the data storage system into the first program;
writing the one or more performance metrics to the data store;
selecting, from among a plurality of performance metrics that are written to the data store and that are indicative of performances of at least a plurality of the multiple available dynamic programs, one or more performance metrics associated with an identifier of the identified dynamic program loaded into the first pr

Assignees

• Ab Initio Technology Llc

Inventors

• Buxbaum Mark
• Mulligan Michael G
• Wakeling Tim
• Atterbury Matthew Darcy

Classifications

• G06Q30/0201

  Market modelling; Market analysis; Collecting market data · CPC title

• G06Q40/06

  Asset management; Financial planning or analysis · CPC title

• G06F2201/865

  Monitoring of software · CPC title

• G06F11/3041

  where the computing system component is an input/output interface (interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units G06F13/00) · CPC title

• G06F11/3452

  Performance evaluation by statistical analysis · CPC title