Graph generation for a distributed event processing system

Patent metadata

Field	Value
Publication number	US-10628424-B2
Application number	US-201715700862-A
Country	US
Kind code	B2
Filing date	Sep 11, 2017
Priority date	Sep 15, 2016
Publication date	Apr 21, 2020
Grant date	Apr 21, 2020

Abstract

An event processing system for processing events in an event stream is disclosed. The system receives information identifying an application and generates a common application runtime model of the application based on the information identifying the application. The system converts the common application runtime model of the application into a first generic representation of the application. The first generic representation of the application is executed in a first target event processing system of a plurality of target event processing systems. The first generic representation of the application comprises a runtime Directed Acyclic Graph (DAG) of components of the application. The system then transmits the first generic representation of the application to the first target event processing system for execution by the first target event processing system.

First claim

What is claimed is:

1. A method of processing an application, the method comprising:
receiving, at a computing device, information identifying an application;
generating, by the computing device, a common application runtime model of the application based at least in part on the information identifying the application;
converting, by the computing device, the common application runtime model of the application into a first generic representation of the application, the first generic representation of the application based at least in part on a first target event processing system of a plurality of target event processing systems, the first generic representation of the application comprising a runtime Directed Acyclic Graph (DAG) of components of the application, the runtime DAG further comprising a DAG of received dataset objects, the DAG of received dataset objects including a lineage graph comprising a DAG of transformations to be executed for the received dataset objects, and a respective dataset object in the lineage graph comprising a pointer to a parent dataset object and metadata specifying a relationship of the respective dataset object with the parent dataset object; and
transmitting, by the computing device, the first generic representation of the application to the first target event processing system for execution by the first target event processing system.

2. The method of claim 1 , wherein the application is expressed as an Event Processing Network (EPN) of components, wherein the information identifying the application comprises at least one of EPN configuration information, query information, and rules associated with the application, and wherein generating the common application runtime model is based at least in part on the EPN configuration information, the query information, or the rules associated with the application.

3. The method of claim 1 , wherein generating the common application runtime model for the application comprises representing the application as a set of one or more configuration blocks, wherein each configuration block represents an event bean with associated metadata.

4. The method of claim 3 , wherein the set of one or more configuration blocks comprises at least one of an inbound socket event bean, an outbound socket event bean, a continuous query language (CQL) processor event bean, or one or more channel event beans.

5. The method of claim 3 , wherein generating the common application runtime model for the application further comprises parsing Event Processing Network (EPN) configuration information and setting the parsed EPN configuration information to each event bean.

6. The method of claim 1 , wherein converting the common application runtime model of the application into the first generic representation of the application comprises converting one or more configuration blocks represented in the common application runtime model of the application into the runtime DAG of components of the application, a respective configuration block of the one or more configuration blocks comprising an identifier corresponding to an event bean, and wherein converting the respective configuration block comprises associating metadata of the event bean and corresponding processing logic with the DAG.

7. The method of claim 6 , further comprising transmitting, by the computing device, the runtime DAG of components of the application for execution by the first target event processing system, wherein the first target event processing system is a distributed event processing system.

8. The method of claim 1 , further comprising converting, by the computing device, the common application runtime model of the application into a second generic representation of the application for execution in a second target event processing system of the plurality of target event processing systems, the second target event processing system being different from the first target event processing system.

9. The method of claim 8 , wherein converting the common application runtime model of the application into the second generic representation of the application comprises converting one or more configuration blocks represented in the common runtime application model of the application into a target representation of the application.

10. The method of claim 9 , further comprising transmitting, by the computing device, the target representation of the application for execution by the second target event processing system, wherein the second target event processing system is an Event Processor system.

11. The method of claim 1 , wherein the received dataset objects comprise Resilient Distributed Dataset (RDD) objects, a respective RDD object comprising a snapshot of input events received during a batch interval.

12. The method of claim 1 , wherein the information identifying the application comprises Event Processing Network (EPN) configuration information, and wherein generating the common application runtime model is based at least in part on the EPN configuration information.

13. A non-transitory computer-readable medium storing computer-executable instructions that, when executed by one or more processors, configures one or more computer systems to perform at least:
instructions that cause the one or more processors to receive information identifying an application;
instructions that cause the one or more processors to generate a common application runtime model of the application based at least in part on the information identifying the application;
instructions that cause the one or more processors to convert the common application runtime model of the application into a first generic representation of the application, the first generic representation of the application based at least in part on a first target event processing system of a plurality of target event processing systems, the first generic representation of the application comprising a runtime Directed Acyclic Graph (DAG) of components of the application, the runtime DAG further comprising a DAG of received dataset objects, the DAG of received dataset objects including a lineage graph comprising a DAG of transformations to be executed for the received dataset objects, and a respective dataset object in the lineage graph comprising a pointer to a parent dataset object and metadata specifying a relationship of the respective dataset object with the parent dataset object; and
instructions that cause the one or more processors to transmit the first generic representation of the application to the first target event processing system for execution by the first target event processing system.

14. The non-transitory computer-readable medium of claim 13 , wherein the application is expressed as an Event Processing Network (EPN) of components, wherein the information identifying the application comprises at least one of EPN configuration information, query information, and rules associated with the application, and wherein generating the common application runtime model is based at least in part on the EPN configuration information, the query information, or the rules associated with the application.

15. The non-transitory computer-readable medium of claim 13 , wherein the instructions that cause the one or more processors to generate the common application runtime model for the application comprises instructions that cause the one or more processors to represent the application as a set of one or more configuration blocks, wherein each configuration block represents an event bean with associated metadata.

16. The non-transitory computer-readable medi

Assignees

• Oracle Int Corp

Inventors

• Park Hoyong
• Geiszter Gyorgy

Classifications

• G06F16/278

  Data partitioning, e.g. horizontal or vertical partitioning · CPC title

• G06F9/542

  Event management; Broadcasting; Multicasting; Notifications · CPC title

• G06F16/24568 Primary

  Data stream processing; Continuous queries · CPC title

• G06F16/248

  Presentation of query results · CPC title

• G06F8/35

  model driven · CPC title