Systems and/or methods for investigating event streams in complex event processing (CEP) applications

Patent metadata

Field	Value
Publication number	US-10089362-B2
Application number	US-201414458806-A
Country	US
Kind code	B2
Filing date	Aug 13, 2014
Priority date	Aug 13, 2014
Publication date	Oct 2, 2018
Grant date	Oct 2, 2018

Abstract

Certain example embodiments relate to techniques for investigating event streams in complex event processing (CEP) environments. Input events from one or more input event streams and query registration-related events from a registration event stream are received. Query registration-related events are associated with actions taken with respect to queries performed on the input event stream(s). Event-based profiles are developed by subjecting the received input events to a profiling CEP engine. Event-based profiles include data mining related and/or statistical characteristics for each input event stream. Query-based profiles are developed by subjecting the received query registration-related events to the CEP engine. Query-based profiles include data indicative of how relevant the queries performed on the input event stream(s) are and/or how those queries are relevant to the input event stream(s) on which they are performed. Query registration-related events are generated when a query on the input event stream(s) is registered, deregistered, etc.

First claim

What is claimed is:

1. A method of profiling one or more event streams using a profiling computer system that includes at least one hardware processor, the one or more event streams delivered via an event bus that is implemented using the at least one hardware processor, the method comprising:
receiving, via the event bus and at the profiling computer system, input events from the one or more event streams emitted to the event bus, the input events also being delivered to at least one production complex event processing (CEP) system;
receiving, via the event bus and at the profiling computer system, query registration-related events from a registration event stream emitted to the event bus, the query registration-related events being generated in response to registration of queries with the at least one production CEP system that are executed thereon against specified ones of the one or more event streams using at least one operator, wherein each query registration-related event includes a reference to at least one of the one or more event streams and operator data that corresponds to how a query that corresponds to the query registration-related event will be executed by the production CEP system;
developing event-based profiles by subjecting the received input events of the one or more event streams to a profiling complex event processing (CEP) engine that is executing using the at least one hardware processor of the profiling computer system, the event-based profiles including data mining related characteristics and/or statistical characteristics for each of the one or more input event streams;
in response to reception of each query registration-related event, generating, using the profiling computer system, a plurality of events, wherein each of the plurality of events is based on a different one of plural operators of the query that corresponds to the query registration-related event;
developing query-based profiles by subjecting the generated plurality of events to the profiling CEP engine, the query-based profiles including data indicative of how relevant the queries performed on the one or more input event streams are and/or how those queries are relevant to the one or more input event streams on which they are performed; and
storing the event-based profiles and the query-based profiles to a non-transitory computer readable storage medium.

2. The method of claim 1 , further comprising maintaining different event-based profiles and different query-based profiles for different timeframes in the non-transitory computer readable storage medium.

3. The method of claim 1 , further comprising storing, to a stream repository, metadata about the one or more event streams accessed by a user of the production CEP system.

4. The method of claim 3 , further comprising creating a new entry in the stream repository each time the production CEP system is connected to a new input event stream.

5. The method of claim 3 , further comprising enabling a user of production CEP system to browse through query-based profiles and/or event-based profiles for input event streams for which there are entries in the stream repository.

6. The method of claim 5 , further comprising (a) automatically removing profiles for queries and/or input event streams deemed irrelevant, and/or (b) organizing queries and/or input event streams based on relevance.

7. The method of claim 1 , wherein at least some of the queries are continuous queries.

8. The method of claim 1 , further comprising deriving at least some of the query-based profiles from query registration-related events without also taking into account information associated with the input events on which the queries associated with the query registration-related events operate.

9. The method of claim 1 , wherein each said query registration-related event includes a query identifier, a query string, a type for the respective query registration-related event, and time-related information.

10. The method of claim 1 , wherein the developing of the query-based profiles further comprises:
analyzing each received query registration-related event to identify at least each input event stream referenced and/or implicated therein, and each operator involved in the associated query; and
analyzing each operator/stream combination in developing the query-based profiles.

11. The method of claim 10 , wherein the analyzing of each operator/stream combination is performed in connection with a continuous query.

12. The method of claim 1 , further comprising making profiles available to stream profiler interface accessible via a development environment that is usable in CEP query definition and deployment.

13. A non-transitory computer readable storage medium tangibly storing a program for profiling one or more event streams using a profiling computer system that includes at least one hardware processor, the one or more event streams delivered via an event bus that is implemented using the at least one hardware processor, the program including instructions that, when executed by processing resources including at least one processor of a computer system, at least:
enable reception, via the event bus and at the profiling computer system, of input events from the one or more input event streams emitted to the event bus, the input events also being delivered to at least one production complex event processing (CEP) system;
enable reception, via the event bus and at the profiling computer system, of query registration-related events from a registration event stream emitted to the event bus, the query registration-related events being generated in response to registration of queries with the at least one production CEP system that are executed thereon against specified ones of the one or more input event streams using at least one operator, wherein each query registration-related event includes a reference to at least one of the input event streams and operator data for plural operators that are part of a corresponding query for the production CEP system;
develop event-based profiles by subjecting the received input events of the one or more event streams to a profiling complex event processing (CEP) engine that is executing using the at least one hardware processor of the profiling computer system, the event-based profiles including data mining related characteristics and/or statistical characteristics for each of the one or more input event streams;
in response to reception of each query registration-related event, generate, using the profiling computer system, a plurality of events, wherein each of the plurality of events is generated based on at least one of the plural operators of the query that corresponds to the query registration-related event, where each of the plural operators is used to generate at least one of the plurality of events;
develop query-based profiles by subjecting the generated plurality of events to the profiling CEP engine, the query-based profiles including data indicative of how relevant the queries performed on the one or more input event streams are and/or how those queries are relevant to the one or more input event streams on which they are performed; and
store the event-based profiles and the query-based profiles to a non-transitory computer readable storage medium.

14. A stream profiler computer system, comprising:
a communications interface that is coupled to an event bus over which events are receivable; and
a processing system that includes at least one hardware processor, the processing system configured to:
execute a profiling complex event processing (CEP) engine;
receive, via the event bus,

Assignees

• Software Ag

Inventors

• Cammert Michael
• Heinz Christoph
• Schaefer Daniel
• Riemenschneider Tobias
• Kraemer Juergen

Classifications

• G06F16/24568 Primary

  Data stream processing; Continuous queries · CPC title

• G06F17/30516 Primary

  Physics · mapped topic